None
**Instruments Affected**: FGS, MIRI, NIRCam, NIRISS
Tested on MIRI Simulated data
This test is designed to test the tweakreg step in the calwebb_image3 pipeline. At the start of the calwebb_image3 pipeline, the shifts between the images in an association table are found. This step creates image catalogs of point-like sources whose centroids are then used to compute corrections to the WCS of the input images such that sky catalogs obtained from the image catalogs using the corrected WCS will align on the sky.
For more information on the pipeline step visit the links below.
Step description: https://jwst-pipeline.readthedocs.io/en/latest/jwst/tweakreg/README.html
Pipeline code: https://github.com/spacetelescope/jwst/tree/master/jwst/tweakreg
The data for this test were created with the MIRI Data Simulator, and the documentation for that code can be found here: http://miri.ster.kuleuven.be/bin/view/Public/MIRISim_Public
A short description and link to the page: https://outerspace.stsci.edu/display/JWSTCC/Vanilla+Refine+WCS
Definition of terms or acronymns.
JWST: James Webb Space Telescope
MIRI: Mid-Infrared Instrument
MIRISim: MIRI Data Simulator
This test is performed by creating a set of simulated data with multiple point sources located at specified coordinates. The simulator puts in the expected distortion, so the initial output data comes out of the simulator in distorted coordinates. When this data is then run through calwebb_detector1, calwebb_image2 and calwebbb_image3, the combined, undistorted image should have the point sources registered at the expected locations. In flight, this test can be repeated with known stars that should be found at their expected coordinates. If there is a shift in coordinates between the images that was not expected, tweakreg will find the sources to create a better image alignment. This is checked by using DAOStarFinder to find the point sources in each image (individual and combined) so that the catalogs can be compared to the expected RA and Dec values that were used to create the images. The user will look at whether the statistics of the combined sources are better or worse than those of the individual images.
The data used in this simulation were created with the MIRISim simulator.
The simulation consists of eight files, two exposures each at four different dither positions. The images used in this test have 50 bright point sources scattered across the images, and were created in the F1130W filter.
# set up import statements
from astropy.io import ascii, fits
from astropy.stats import sigma_clipped_stats
from astropy.table import Column
from astropy.visualization import SqrtStretch
from astropy.visualization.mpl_normalize import ImageNormalize
from astropy import table
from astropy.table import Table
import astropy.units as u
from astropy.coordinates import SkyCoord, match_coordinates_sky
#from ci_watson.artifactory_helpers import get_bigdata
import glob
from itertools import product
from ci_watson.artifactory_helpers import get_bigdata
# Box download imports
from astropy.utils.data import download_file
from pathlib import Path
from shutil import move
from os.path import splitext
from jwst.datamodels import DrizProductModel, ImageModel
from jwst.pipeline import Detector1Pipeline, Image2Pipeline, Image3Pipeline
from jwst import associations
from jwst.associations.lib.rules_level3_base import DMS_Level3_Base
from jwst.associations import asn_from_list
import math
import matplotlib.pyplot as plt
import numpy as np
import os
from photutils import CircularAperture, DAOStarFinder, CircularAnnulus, aperture_photometry
# Create a temporary directory to hold notebook output, and change the working directory to that directory.
from tempfile import TemporaryDirectory
import os
data_dir = TemporaryDirectory()
os.chdir(data_dir.name)
print(data_dir)
<TemporaryDirectory '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0'>
#print("Downloading input files")
#This readnoise file is needed for use with simulated data which has higher readnoise than actual data.
#readnoise = get_bigdata('jwst_validation_notebooks',
# 'validation_data',
# 'jump',
# 'jump_miri_test',
# 'jwst_mirisim_readnoise.fits')
#filelist = ['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits',
# 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits',
# 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits',
# 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits',
# 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits',
# 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits',
# 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits',
# 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits']
#for file in filelist:
# input_file = get_bigdata('jwst_validation_notebooks',
# 'validation_data',
# 'outlier_detection',
# 'outlier_detection_miri_test',
# file)
#coords = get_bigdata('jwst_validation_notebooks',
# 'validation_data',
# 'resample',
# 'resample_miri_test',
# 'radec_4ptdith_50star_mosaic_coords.txt')
#print("Finished Downloads")
# Read rate files in from Box rather than starting with uncal and running through calwebb_detector1
def get_box_files(file_list):
for box_url,file_name in file_list:
if 'https' not in box_url:
box_url = 'https://stsci.box.com/shared/static/' + box_url
downloaded_file = download_file(box_url)
if Path(file_name).suffix == '':
ext = splitext(box_url)[1]
file_name += ext
move(downloaded_file, file_name)
file_urls = ['https://stsci.box.com/shared/static/46kwitm6fswmeiuw4gu6xxgeioy7dhca.fits',
'https://stsci.box.com/shared/static/8vs4njvio6y15cdcl3rjtb4veb55h6o9.fits',
'https://stsci.box.com/shared/static/09xjv0lpe35o50f2xf4ydu523g03s9fd.fits',
'https://stsci.box.com/shared/static/tqay5edhq1hstayk897ugd8t5sjbbjme.fits',
'https://stsci.box.com/shared/static/rmri5jb6gwpezva2rgzkkguoeos7nocv.fits',
'https://stsci.box.com/shared/static/pdtjm55j5ahj08i1rm91jw5p2ijpvi68.fits',
'https://stsci.box.com/shared/static/bw5jsrorue4g2eprpd06w8sdvy6etqhv.fits',
'https://stsci.box.com/shared/static/y3thiqwcyihw30vndpy16o8bjxn36o89.fits',
'https://stsci.box.com/shared/static/u2wc9ocug98ut8arz383oid0eru06qbo.txt']
file_names = ['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits',
'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits',
'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits',
'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits',
'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits',
'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits',
'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits',
'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits',
'radec_4ptdith_50star_mosaic_coords.txt']
box_download_list = [(url,name) for url,name in zip(file_urls,file_names)]
get_box_files(box_download_list)
coords = 'radec_4ptdith_50star_mosaic_coords.txt'
# Run the calwebb_detector1 pipeline
# set up pipeline parameters
#rej_thresh=10.0 # rejection threshold for jump step
#print('There are ', len(filelist), ' images.')
#slopelist = []
# loop over list of files
#for file in filelist:
# set up pipeline parameters for input
# pipe1 = Detector1Pipeline()
# pipe1.jump.rejection_threshold = rej_thresh
# pipe1.jump.override_readnoise = readnoise
# pipe1.ramp_fit.override_readnoise = readnoise
# pipe1.refpix.skip = True # needs update to simulator for this to work properly with simulated data
# set up output file name
# base, remainder = file.split('.')
# outname = base
# pipe1.jump.output_file = outname+'.fits'
#pipe1.ramp_fit.output_file = outname+'.fits'
# pipe1.output_file = outname+'.fits'
# Run pipeline on each file
# rampfile = pipe1.run(file)
# slopelist.append(rampfile)
# Close the input files
#file.close()
#print('Detector 1 steps completed on all files.')
#print(slopelist)
slopelist = ['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits',
'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits',
'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits',
'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits',
'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits',
'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits',
'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits',
'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits']
# Run Calwebb_image2 on output files from detector1
print('There are ', len(slopelist), ' images.')
callist = []
ratefilenames = []
# cycle through files
for file in slopelist:
rampfile = ImageModel(file)
# create an object for the pipeline
pipe2 = Image2Pipeline()
filename = rampfile.meta.filename
ratefilenames.append(filename)
# Set pipeline parameters
pipe2.save_results = True
pipe2.output_file = filename +'_cal.fits'
pipe2.resample.save_results = True
pipe2.suffix = None
calfile = pipe2.run(rampfile)
callist.append(calfile)
print(callist)
There are 8 images.
2021-10-30 15:31:43,928 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:31:43,930 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:31:43,932 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:31:43,933 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:31:43,934 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:31:43,936 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:31:44,056 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:44,064 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:31:44,076 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:31:44,386 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:31:44,389 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:31:44,391 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:31:44,392 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:31:44,393 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:31:44,394 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:31:44,398 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:31:44,401 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:31:44,402 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:31:44,404 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:31:44,406 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:31:44,407 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:31:44,408 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:31:44,409 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:31:44,409 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:31:44,410 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:31:44,411 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:31:44,412 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:31:44,414 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:31:44,415 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:31:44,416 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:31:44,416 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:31:44,417 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:31:44,418 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:31:44,487 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal
2021-10-30 15:31:44,489 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits> ...
2021-10-30 15:31:44,666 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:44,669 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:31:44,860 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:31:44,930 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.019410529 -0.016138544 0.021878136 0.015048625 359.990819026 0.017621279 359.988011958 -0.013579591
2021-10-30 15:31:44,931 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.019410529 -0.016138544 0.021878136 0.015048625 359.990819026 0.017621279 359.988011958 -0.013579591
2021-10-30 15:31:44,932 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:31:44,967 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:31:45,017 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:31:45,138 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:45,140 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:31:45,259 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:45,260 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:45,261 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:45,269 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:45,386 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:31:45,536 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:45,538 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:31:45,566 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:31:45,567 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:31:45,641 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:31:45,642 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:31:45,643 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:31:45,645 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:31:45,682 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:31:45,683 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:31:45,685 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:31:45,698 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:31:45,849 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:45,852 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:31:45,876 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:31:45,985 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:31:46,728 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:31:47,254 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:31:47,927 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:31:48,451 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:31:49,032 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:31:49,572 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:31:50,203 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:31:50,775 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:31:50,779 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.019358646 -0.016334386 0.022108876 0.015005126 359.990738698 0.017758047 359.987988468 -0.013581465
2021-10-30 15:31:50,899 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_i2d.fits
2021-10-30 15:31:50,901 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:31:50,902 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal
2021-10-30 15:31:50,904 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:31:51,060 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits
2021-10-30 15:31:51,061 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2021-10-30 15:31:51,095 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:31:51,097 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:31:51,100 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:31:51,102 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:31:51,103 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:31:51,106 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:31:51,289 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:31:51,296 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:31:51,304 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:31:51,308 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:31:51,311 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:31:51,312 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:31:51,312 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:31:51,313 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:31:51,314 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:31:51,316 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:31:51,318 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:31:51,319 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:31:51,321 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:31:51,322 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:31:51,323 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:31:51,323 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:31:51,324 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:31:51,325 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:31:51,325 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:31:51,326 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:31:51,327 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:31:51,328 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:31:51,329 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:31:51,330 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:31:51,331 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:31:51,332 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:31:51,332 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:31:51,396 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal
2021-10-30 15:31:51,397 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits> ...
2021-10-30 15:31:51,556 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:31:51,559 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:31:51,727 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:31:51,782 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:31:51,788 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.019410529 -0.016138544 0.021878136 0.015048625 359.990819026 0.017621279 359.988011958 -0.013579591
2021-10-30 15:31:51,789 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.019410529 -0.016138544 0.021878136 0.015048625 359.990819026 0.017621279 359.988011958 -0.013579591
2021-10-30 15:31:51,790 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:31:51,823 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:31:51,872 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:31:52,016 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:31:52,018 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:31:52,128 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:52,130 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:52,131 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:52,138 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:52,253 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:31:52,407 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:31:52,409 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:31:52,433 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:31:52,434 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:31:52,503 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:31:52,504 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:31:52,505 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:31:52,506 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:31:52,537 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:31:52,538 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:31:52,539 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:31:52,552 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:31:52,702 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:31:52,704 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:31:52,729 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:31:52,835 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:31:53,538 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:31:54,064 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:31:54,783 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:31:55,319 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:31:55,988 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:31:56,512 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:31:57,090 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:31:57,626 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:31:57,630 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.019358646 -0.016334386 0.022108876 0.015005126 359.990738698 0.017758047 359.987988468 -0.013581465
2021-10-30 15:31:57,728 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_i2d.fits
2021-10-30 15:31:57,729 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:31:57,730 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal
2021-10-30 15:31:57,733 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:31:57,865 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits
2021-10-30 15:31:57,866 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2021-10-30 15:31:57,900 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:31:57,902 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:31:57,904 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:31:57,906 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:31:57,908 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:31:57,910 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:31:58,077 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:58,085 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:31:58,093 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:31:58,097 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:31:58,100 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:31:58,101 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:31:58,102 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:31:58,103 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:31:58,103 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:31:58,105 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:31:58,107 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:31:58,107 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:31:58,109 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:31:58,111 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:31:58,111 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:31:58,112 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:31:58,113 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:31:58,113 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:31:58,114 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:31:58,115 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:31:58,115 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:31:58,117 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:31:58,117 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:31:58,118 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:31:58,118 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:31:58,119 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:31:58,119 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:31:58,175 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal
2021-10-30 15:31:58,178 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits> ...
2021-10-30 15:31:58,374 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:58,377 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:31:58,548 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:31:58,609 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:31:58,614 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020049678 -0.017460337 0.022517284 0.013726832 359.991458175 0.016299486 359.988651107 -0.014901383
2021-10-30 15:31:58,615 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020049678 -0.017460337 0.022517284 0.013726832 359.991458175 0.016299486 359.988651107 -0.014901383
2021-10-30 15:31:58,616 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:31:58,650 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:31:58,700 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:31:58,798 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:58,800 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:31:58,907 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:58,908 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:58,909 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:58,916 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:31:59,029 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:31:59,131 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:59,134 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:31:59,158 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:31:59,159 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:31:59,227 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:31:59,228 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:31:59,229 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:31:59,230 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:31:59,266 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:31:59,268 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:31:59,270 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:31:59,281 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:31:59,381 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:31:59,383 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:31:59,409 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:31:59,515 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:32:00,176 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:00,707 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:32:01,338 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:01,870 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:32:02,490 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:03,015 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:32:03,638 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:04,185 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:04,188 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.019997794 -0.017656179 0.022748024 0.013683333 359.991377847 0.016436254 359.988627617 -0.014903258
2021-10-30 15:32:04,294 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_i2d.fits
2021-10-30 15:32:04,296 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:32:04,296 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal
2021-10-30 15:32:04,299 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:32:04,437 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits
2021-10-30 15:32:04,438 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2021-10-30 15:32:04,472 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:32:04,474 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:32:04,476 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:32:04,478 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:32:04,480 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:32:04,482 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:32:04,628 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:04,633 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:32:04,646 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:32:04,650 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:32:04,652 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:32:04,653 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:32:04,654 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:32:04,654 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:32:04,655 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:32:04,657 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:32:04,659 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:32:04,659 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:32:04,660 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:32:04,662 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:32:04,663 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:32:04,663 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:32:04,664 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:32:04,665 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:32:04,666 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:32:04,667 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:32:04,668 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:32:04,669 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:32:04,670 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:32:04,670 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:32:04,671 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:32:04,671 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:32:04,672 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:32:04,723 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal
2021-10-30 15:32:04,725 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits> ...
2021-10-30 15:32:04,826 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:04,828 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:32:05,001 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:32:05,058 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:05,063 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020049678 -0.017460337 0.022517284 0.013726832 359.991458175 0.016299486 359.988651107 -0.014901383
2021-10-30 15:32:05,064 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020049678 -0.017460337 0.022517284 0.013726832 359.991458175 0.016299486 359.988651107 -0.014901383
2021-10-30 15:32:05,065 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:32:05,102 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:32:05,153 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:32:05,248 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:05,250 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:32:05,360 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:05,362 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:05,363 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:05,373 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:05,488 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:32:05,586 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:05,588 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:32:05,614 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:32:05,615 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:32:05,682 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:32:05,683 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:32:05,684 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:32:05,685 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:32:05,718 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:32:05,720 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:32:05,721 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:32:05,734 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:32:05,844 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:05,847 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:32:05,874 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:32:05,979 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:32:06,684 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:07,210 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:32:07,889 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:08,415 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:32:09,000 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:09,527 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:32:10,116 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:10,662 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:10,665 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.019997794 -0.017656179 0.022748024 0.013683333 359.991377847 0.016436254 359.988627617 -0.014903258
2021-10-30 15:32:10,766 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_i2d.fits
2021-10-30 15:32:10,767 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:32:10,768 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal
2021-10-30 15:32:10,770 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:32:10,904 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits
2021-10-30 15:32:10,906 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2021-10-30 15:32:10,939 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:32:10,941 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:32:10,944 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:32:10,946 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:32:10,947 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:32:10,950 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:32:11,060 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:11,065 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:32:11,074 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:32:11,078 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:32:11,080 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:32:11,081 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:32:11,081 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:32:11,082 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:32:11,083 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:32:11,084 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:32:11,086 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:32:11,086 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:32:11,087 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:32:11,089 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:32:11,090 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:32:11,091 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:32:11,091 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:32:11,092 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:32:11,092 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:32:11,093 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:32:11,093 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:32:11,095 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:32:11,095 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:32:11,096 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:32:11,096 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:32:11,097 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:32:11,097 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:32:11,139 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal
2021-10-30 15:32:11,140 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits> ...
2021-10-30 15:32:11,243 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:11,245 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:32:11,420 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:32:11,473 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:11,478 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020280823 -0.019911110 0.022748429 0.011276059 359.991689320 0.013848713 359.988882252 -0.017352157
2021-10-30 15:32:11,479 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020280823 -0.019911110 0.022748429 0.011276059 359.991689320 0.013848713 359.988882252 -0.017352157
2021-10-30 15:32:11,480 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:32:11,517 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:32:11,568 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:32:11,671 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:11,673 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:32:11,777 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:11,779 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:11,780 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:11,787 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:11,903 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:32:12,003 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:12,005 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:32:12,029 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:32:12,030 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:32:12,098 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:32:12,099 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:32:12,099 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:32:12,100 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:32:12,132 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:32:12,134 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:32:12,135 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:32:12,147 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:32:12,246 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:12,249 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:32:12,274 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:32:12,384 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:32:13,088 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:13,623 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:32:14,352 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:14,890 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:32:15,568 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:16,097 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:32:16,685 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:17,226 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:17,229 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020228939 -0.020106952 0.022979169 0.011232559 359.991608992 0.013985480 359.988858761 -0.017354031
2021-10-30 15:32:17,332 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_i2d.fits
2021-10-30 15:32:17,334 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:32:17,334 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal
2021-10-30 15:32:17,338 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:32:17,478 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits
2021-10-30 15:32:17,479 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2021-10-30 15:32:17,513 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:32:17,515 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:32:17,517 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:32:17,519 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:32:17,521 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:32:17,524 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:32:17,673 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:17,679 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:32:17,688 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:32:17,692 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:32:17,694 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:32:17,695 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:32:17,696 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:32:17,697 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:32:17,698 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:32:17,700 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:32:17,701 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:32:17,702 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:32:17,704 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:32:17,705 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:32:17,706 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:32:17,706 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:32:17,707 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:32:17,708 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:32:17,709 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:32:17,710 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:32:17,710 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:32:17,712 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:32:17,712 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:32:17,713 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:32:17,714 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:32:17,714 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:32:17,715 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:32:17,766 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal
2021-10-30 15:32:17,767 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits> ...
2021-10-30 15:32:17,870 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:17,872 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:32:18,044 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:32:18,100 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:18,105 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020280823 -0.019911110 0.022748429 0.011276059 359.991689320 0.013848713 359.988882252 -0.017352157
2021-10-30 15:32:18,106 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020280823 -0.019911110 0.022748429 0.011276059 359.991689320 0.013848713 359.988882252 -0.017352157
2021-10-30 15:32:18,107 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:32:18,145 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:32:18,196 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:32:18,310 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:18,312 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:32:18,421 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:18,422 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:18,424 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:18,431 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:18,546 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:32:18,648 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:18,650 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:32:18,675 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:32:18,676 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:32:18,745 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:32:18,745 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:32:18,746 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:32:18,747 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:32:18,781 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:32:18,782 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:32:18,784 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:32:18,798 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:32:18,898 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:18,900 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:32:18,925 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:32:19,030 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:32:19,737 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:20,266 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:32:20,946 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:21,478 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:32:22,060 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:22,583 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:32:23,225 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:23,782 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:23,786 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020228939 -0.020106952 0.022979169 0.011232559 359.991608992 0.013985480 359.988858761 -0.017354031
2021-10-30 15:32:23,893 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_i2d.fits
2021-10-30 15:32:23,894 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:32:23,895 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal
2021-10-30 15:32:23,897 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:32:24,038 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits
2021-10-30 15:32:24,039 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2021-10-30 15:32:24,072 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:32:24,075 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:32:24,077 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:32:24,079 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:32:24,081 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:32:24,083 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:32:24,211 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:24,218 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:32:24,227 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:32:24,230 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:32:24,233 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:32:24,234 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:32:24,235 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:32:24,236 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:32:24,237 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:32:24,239 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:32:24,240 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:32:24,241 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:32:24,243 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:32:24,245 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:32:24,246 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:32:24,247 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:32:24,247 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:32:24,248 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:32:24,248 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:32:24,249 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:32:24,249 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:32:24,251 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:32:24,251 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:32:24,253 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:32:24,253 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:32:24,254 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:32:24,255 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:32:24,310 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal
2021-10-30 15:32:24,311 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits> ...
2021-10-30 15:32:24,417 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:24,419 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:32:24,590 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:32:24,646 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:24,650 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.021816705 -0.019412262 0.024284311 0.011774907 359.993225201 0.014347561 359.990418134 -0.016853309
2021-10-30 15:32:24,651 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.021816705 -0.019412262 0.024284311 0.011774907 359.993225201 0.014347561 359.990418134 -0.016853309
2021-10-30 15:32:24,652 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:32:24,686 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:32:24,735 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:32:24,833 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:24,835 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:32:24,943 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:24,944 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:24,946 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:24,953 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:25,067 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:32:25,169 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:25,171 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:32:25,197 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:32:25,198 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:32:25,265 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:32:25,266 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:32:25,266 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:32:25,267 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:32:25,299 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:32:25,301 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:32:25,302 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:32:25,316 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:32:25,415 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2021-10-30 15:32:25,417 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:32:25,441 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:32:25,543 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:32:26,213 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:26,731 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:32:27,375 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:27,902 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:32:28,558 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:29,102 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:32:29,723 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:30,257 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:30,259 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021764821 -0.019608104 0.024515051 0.011731407 359.993144874 0.014484328 359.990394643 -0.016855183
2021-10-30 15:32:30,360 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_i2d.fits
2021-10-30 15:32:30,361 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:32:30,362 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal
2021-10-30 15:32:30,364 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:32:30,497 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits
2021-10-30 15:32:30,498 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2021-10-30 15:32:30,532 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:32:30,534 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:32:30,536 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:32:30,538 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:32:30,540 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:32:30,542 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:32:30,695 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:30,701 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:32:30,709 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:32:30,713 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:32:30,716 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:32:30,717 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:32:30,717 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:32:30,718 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:32:30,718 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:32:30,720 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:32:30,722 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:32:30,722 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:32:30,724 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:32:30,725 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:32:30,725 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:32:30,726 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:32:30,727 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:32:30,727 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:32:30,728 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:32:30,729 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:32:30,729 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:32:30,731 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:32:30,731 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:32:30,732 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:32:30,732 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:32:30,733 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:32:30,734 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:32:30,779 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal
2021-10-30 15:32:30,780 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits> ...
2021-10-30 15:32:30,886 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:30,888 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:32:31,059 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:32:31,110 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:31,114 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.021816705 -0.019412262 0.024284311 0.011774907 359.993225201 0.014347561 359.990418134 -0.016853309
2021-10-30 15:32:31,116 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.021816705 -0.019412262 0.024284311 0.011774907 359.993225201 0.014347561 359.990418134 -0.016853309
2021-10-30 15:32:31,116 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:32:31,150 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:32:31,199 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:32:31,299 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:31,302 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:32:31,408 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:31,409 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:31,410 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:31,418 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:32:31,531 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:32:31,635 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:31,637 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:32:31,662 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:32:31,663 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:32:31,730 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:32:31,731 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:32:31,732 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:32:31,733 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:32:31,765 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:32:31,766 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:32:31,767 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:32:31,783 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:32:31,901 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:32:31,904 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:32:31,928 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:32:32,032 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:32:32,697 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:33,217 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:32:33,809 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:34,334 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:32:34,927 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:35,449 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:32:36,054 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:32:36,589 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:32:36,591 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021764821 -0.019608104 0.024515051 0.011731407 359.993144874 0.014484328 359.990394643 -0.016855183
2021-10-30 15:32:36,690 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_i2d.fits
2021-10-30 15:32:36,691 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:32:36,692 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal
2021-10-30 15:32:36,694 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:32:36,829 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits
2021-10-30 15:32:36,830 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
[[<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits>]]
imagelist = [ele.replace('rate', 'cal') for ele in ratefilenames]
print(imagelist)
['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits']
This test uses MIRISim data using only the simulated dithers, and no shifts. Two exposures each of four different dithers, perfect alignment.
First look at the cal images out of calwebb_image2.
# find stars and get RA, Dec from *_cal.fits files
# Run DAOStarFinder to find sources in image
allRAdiff_cal = []
allDecdiff_cal = []
for calimage in imagelist:
image = ImageModel(calimage)
# pull out data portion of input file
data = image.data
# print stats on input image
print(calimage)
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
# using wcs info from images, put coordinates into RA, Dec
ra, dec = image.meta.wcs(sources['xcentroid'], sources['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
print()
# read in text file with RA and Dec input coordinates
RA_in, Dec_in = np.loadtxt( coords, dtype=str, unpack=True)
# put RA and Dec into floats
RA_sim = RA_in.astype(float)
Dec_sim = Dec_in.astype(float)
# Put ra, dec coords into a table
cat1_sim = Table([RA_sim, Dec_sim], names=('ra', 'dec'))
cat2_calc = Table([ra, dec], names=('ra', 'dec'))
# Get coordinates with SkyCoord for each catalog
coord_cat1_sim = SkyCoord(ra=cat1_sim['ra'], dec=cat1_sim['dec'], unit="deg")
coord_cat2_calc = SkyCoord(ra=cat2_calc['ra'], dec=cat2_calc['dec'], unit="deg")
ind_cat2_cat1, dist_2d, _ = match_coordinates_sky(coord_cat1_sim, coord_cat2_calc)
# Find where the catalogs match
cat1_matched = cat1_sim[dist_2d.arcsec<0.05]
cat2_matched = cat2_calc[ind_cat2_cat1[dist_2d.arcsec<0.05]]
#print(cat1_matched)
# Get differences in RA, Dec
ra_diff = cat2_matched['ra'] - cat1_matched['ra']
dec_diff = cat2_matched['dec'] - cat1_matched['dec']
#print(ra_diff)
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
# Compare input RA, Dec to found RA, Dec
print('RA_Diff (mas) Dec_diff (mas) pass/fail')
# Find if the differences are within the allowed 30 mas range
for i in np.arange(0,len(ra_diff)):
#if ra_diff[i] < 30 and dec_diff[i] < 30:
allRAdiff_cal.append(ra_diff[i])
allDecdiff_cal.append(dec_diff[i])
if abs(ra_diff[i]) < 30 and abs(dec_diff[i]) < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {}'.format(ra_diff[i], dec_diff[i], test))
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in milliarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(ra_diff,dec_diff)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
meanRAdiff_cal, medianRAdiff_cal, stdRAdiff_cal = sigma_clipped_stats(allRAdiff_cal, sigma=5.0, maxiters=5) # default sigma=3
meanDecdiff_cal, medianDecdiff_cal, stdDecdiff_cal = sigma_clipped_stats(allDecdiff_cal, sigma=5.0, maxiters=5) # default sigma=3
print('RA difference mean, median and std (units in mas)',meanRAdiff_cal, medianRAdiff_cal, stdRAdiff_cal)
print('Dec difference mean, median and std (units in mas)',meanDecdiff_cal, medianDecdiff_cal, stdDecdiff_cal)
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits
Image mean, median and std 11.393542 10.826687 55.011623
xcentroid ycentroid RA Dec
------------------ ------------------ --------------------- ----------------------
608.5415674187961 2.5119766176307223 0.0008812919624467749 -0.014594789515541495
685.5194495798157 5.5188105009736175 359.9985262521632 -0.014309517462321978
886.3394041097413 32.119070281158955 359.99243205390275 -0.012997454423196865
953.8640393199 37.04011242844017 359.9903742953238 -0.012674257323148128
444.47609551197064 61.922582668650286 0.006066875156909462 -0.013223542150700983
708.539078792773 73.05874981354657 359.9979903713137 -0.01222441448341229
373.69156711571156 82.73445867221936 0.00829150779169885 -0.012772340592118013
429.1719580852977 96.9350873606011 0.0066252609207797806 -0.01220541183653611
486.33656250883286 111.09479540127342 0.0049071267763785495 -0.011634212317900124
812.818016502769 135.61499300669485 359.9949510782622 -0.010070810306428344
550.2541709849713 143.00728324989907 0.003027257861743836 -0.010506369320026828
856.669674639311 163.941532747077 359.99367943542825 -0.009101781916248714
943.4770993700253 165.11663853495494 359.99102011241314 -0.008847567308604684
379.3675519242359 175.61124295871804 0.008352878219398573 -0.009943295128109814
390.9846006266449 182.23371017799838 0.008013454071705377 -0.009712529245328462
464.78741113955334 193.6264598801728 0.005779073595006636 -0.009180116965875892
706.4675734066059 205.4374537771488 359.99839582116016 -0.008215197294039717
471.0120867553802 208.50201007466694 0.005626274700481911 -0.008710684120420042
848.6281552463014 225.05905956689554 359.99408676890266 -0.007263193491265538
717.2680096211556 238.78542812577177 359.9981519861035 -0.007170315851777638
640.8254738397458 287.3850110723211 0.000623866158697791 -0.005872632451303791
696.647862932052 311.4570263322215 359.9989761969678 -0.004996253375845009
534.5080406150863 350.3689320851547 0.004046584544183354 -0.004204164820881179
432.09694109427744 418.3411466005772 0.007357153703276762 -0.002371455183037188
665.3824794715022 444.0669679431664 0.0002867232340403056 -0.0009972307220539013
704.8442236777602 454.5198152664274 359.999107133171 -0.000579048618063702
397.1594591938331 455.0466542459958 0.008519471619160033 -0.0013305641705300796
670.371981463498 468.5413077513855 0.0001994299693774992 -0.0002316467303177302
857.038262255815 554.7270783588783 359.9947248543858 0.0028686960910657405
890.8576431575337 564.4910139563399 359.99371776586474 0.0032483115672433368
971.7410107427238 581.0301273603288 359.99129032918023 0.00394460501697729
769.8182651492822 587.3991534539016 359.99748044484795 0.003666592325947924
815.4649708309157 621.70236297117 359.9961801265635 0.004829526225418064
457.3069563867852 695.4839439228793 0.007299417401295441 0.006221092374688667
663.7522305772287 727.5606487303378 0.0010956440902465164 0.007718343531580888
956.3618123173031 732.7240339832271 359.99218701382824 0.008563603509703683
762.012822991855 738.3493833972611 359.9981307363725 0.008284707812831934
475.7809197718267 787.1175421157932 0.006972911155176817 0.009078806556077986
820.4534971417371 846.8578899992237 359.9966476213018 0.011744457761829495
775.2535830946825 852.768447668375 359.99803938143555 0.011819236104458666
821.2496942034151 862.1639462053263 359.9966653732796 0.012214125952000665
811.2868482580394 907.0113339507423 359.9970911975458 0.013560409281168691
979.8333015194123 908.5670123070836 359.99196470996947 0.013994547909521428
798.8612490361676 917.691370731965 359.9974981525205 0.013857233119648482
757.3289724429274 919.148267240695 359.99876455354797 0.01380396414649375
897.3875798865843 936.7583695764755 359.99455365921426 0.014667036969114682
628.0267683752969 974.7373812387208 0.0028386713057134997 0.015187773153686161
456.3574329732993 987.6670781265088 0.008076589320650552 0.015153509703638865
RA_Diff (mas) Dec_diff (mas) pass/fail
-5.207227 3.470927 pass
-3.050926 4.439231 pass
-0.996357 -4.430599 pass
0.939315 2.117388 pass
11.707788 5.337136 pass
7.149973 6.062934 pass
0.553332 -5.238659 pass
1.601453 -5.067627 pass
1.697829 -5.631014 pass
-1.281275 -9.563286 pass
-4.963313 1.647943 pass
3.280159 -0.696398 pass
6.368050 6.503431 pass
0.456395 2.835656 pass
2.121554 1.834933 pass
5.167542 4.385102 pass
-1.183299 2.783353 pass
-2.226832 4.449976 pass
-4.049435 1.648257 pass
0.479416 -0.175025 pass
4.309084 2.687847 pass
-2.888835 5.073412 pass
1.185049 -5.021939 pass
7.481744 4.282897 pass
1.336729 5.707860 pass
-2.097355 -14.067451 pass
-3.550218 -8.627365 pass
-1.495641 -4.193355 pass
0.264942 3.178923 pass
-1.044110 -1.627526 pass
1.063166 -0.926363 pass
-1.226829 3.733089 pass
-3.144371 -8.905588 pass
-0.949059 -4.651874 pass
1.828050 2.373868 pass
1.634658 5.294717 pass
-0.842887 -2.478358 pass
-2.052110 1.271771 pass
-0.524211 -8.294072 pass
0.194050 -1.635924 pass
0.988922 8.337166 pass
-0.438410 2.537539 pass
-2.256193 4.053427 pass
0.928302 5.870448 pass
7.604687 1.557689 pass
2.956177 10.089741 pass
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits
Image mean, median and std 11.394609 10.827406 55.007805
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
608.5461714111817 2.5131153270429225 0.0008811535076687153 -0.014594743852346248
685.5165542363047 5.522005289569982 359.9985263490218 -0.014309429398466314
886.3377102041173 32.12032234845156 359.99243210897583 -0.012997421405947096
953.858650908105 37.038714754591744 359.99037445698593 -0.012674313169426505
444.4760693354769 61.921174725845646 0.006066872395400456 -0.013223584608591675
708.5375051993097 73.05653065791925 359.9979904139565 -0.012224485327696166
373.6920713251912 82.73362445593573 0.008291490212003361 -0.012772364504572807
429.1710480615856 96.9361473590585 0.0066252915340002895 -0.012205382067991825
486.33656507950644 111.0929968883717 0.004907122116154008 -0.011634266764592633
812.8169111357602 135.61175256667016 359.9949511037864 -0.010070911221503798
550.2506815991629 143.0082980431957 0.003027367540328657 -0.010506347247348124
856.666574138678 163.94025852158114 359.99367952721065 -0.009101828365468878
943.4725862005791 165.1160847976937 359.9910202493613 -0.008847595467969826
379.36603019242443 175.61024962497083 0.008352922362656737 -0.009943329177441321
390.9868475960879 182.23166489994372 0.008013379965691413 -0.009712585890208804
464.7874252509071 193.62567333213758 0.00577907114864779 -0.009180140912869495
706.4641169351513 205.44112744056818 359.99839593680207 -0.00821509388991974
471.0128665836423 208.50627769129127 0.005626261725713367 -0.008710551901505456
848.6275210111238 225.06047475891756 359.9940867921008 -0.007263151929571056
717.2689344128596 238.78521514635145 359.99815195717895 -0.00717032006242251
640.8223349387042 287.3876388648545 0.0006239692904470007 -0.005872559700757004
696.649043669952 311.4598971472418 359.9989761683857 -0.004996162404240498
534.5084442349707 350.37099693129943 0.004046577556716191 -0.00420410034973628
432.09618931856727 418.3419770115535 0.00735717883136822 -0.0023714315343018777
665.3849005558758 444.0678377273824 0.00028665146587420707 -0.0009971980130367556
704.8443491573435 454.5162471160152 359.99910711974667 -0.0005791581225037081
397.16046445276737 455.04418207058586 0.008519434584673621 -0.0013306377093679634
670.369979887094 468.54191939872646 0.00019949283603036086 -0.00023163279961321113
857.0397112859981 554.7274188893667 359.99472481101884 0.002868709976703097
890.8578568837343 564.4940272892437 359.9937177677001 0.0032484046780216053
971.7393022215407 581.0309188009905 359.9912903836618 0.00394462536976469
769.8173270515161 587.4004878427158 359.9974804771503 0.0036666311271152862
815.465578086775 621.703407654051 359.99618011089166 0.004829559764486471
457.30976496488194 695.4853021868445 0.007299335355773578 0.006221141229410244
663.7519356998866 727.5614345432715 0.001095655178011445 0.0077183669280205805
956.3618069104094 732.7218311115429 359.992187007799 0.008563535989006233
762.0142852652106 738.3497994697638 359.9981306929402 0.008284724036588096
475.77984981811954 787.1204617950921 0.006972951205655511 0.009078893288449403
820.4530900979327 846.8571043631532 359.99664763153703 0.011744432795549499
775.2564955710666 852.7653273770777 359.9980392843252 0.011819147585457136
821.2501449789805 862.1642779577346 359.99666536047 0.01221413713982896
811.2847022881816 907.0118295127575 359.99709126416207 0.013560419393838364
979.8325668501478 908.565764385858 359.99196472886814 0.01399450816804262
798.8585276961667 917.6911602746128 359.9974982346854 0.013857220326868504
757.3271158499823 919.1512240355106 359.9987646179659 0.013804049958067223
897.3858508178394 936.7555527010198 359.9945537040557 0.014666947106948183
628.02654407017 974.7375500319221 0.0028386785543619677 0.015187777746555775
456.3583448650907 987.6657631916269 0.008076558329031239 0.015153471999927788
RA_Diff (mas) Dec_diff (mas) pass/fail
-4.975323 3.779849 pass
-2.755133 4.393177 pass
-1.254723 -4.312847 pass
1.049522 2.224555 pass
12.056479 5.654166 pass
7.045844 6.047775 pass
0.643793 -5.153523 pass
1.717741 -4.927942 pass
1.564505 -5.895754 pass
-1.241359 -9.479059 pass
-4.926467 1.558064 pass
3.424340 -0.384162 pass
6.451563 6.653054 pass
0.439618 2.639647 pass
2.009985 1.699200 pass
5.497958 4.217884 pass
-1.157204 2.799888 pass
-2.576429 4.131308 pass
-4.059377 1.495409 pass
0.431088 -0.569241 pass
4.206189 3.015345 pass
-2.649017 5.109818 pass
1.381183 -4.948669 pass
7.573631 3.919603 pass
1.490243 5.452820 pass
-2.392719 -13.891574 pass
-3.571924 -8.870440 pass
-1.520796 -3.961259 pass
0.256135 3.092714 pass
-0.976075 -1.770595 pass
1.645149 -1.127410 pass
-1.065399 3.409585 pass
-3.200790 -8.784848 pass
-1.105415 -4.593468 pass
1.764763 2.287784 pass
1.367876 5.090795 pass
-0.836280 -2.143159 pass
-1.825790 1.321921 pass
-0.680332 -8.244084 pass
0.392313 -1.517061 pass
0.942213 8.813155 pass
-0.279494 2.414961 pass
-2.302308 4.093703 pass
1.323145 5.949910 pass
8.097701 1.456315 pass
3.372487 10.461996 pass
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits
Image mean, median and std 11.459499 10.829639 55.680965
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
632.757520509536 43.52799873198921 0.0008804967979520648 -0.014626457969967293
709.8257801184594 47.507856164720145 359.99852516247785 -0.014311550857858348
910.5959218383333 74.15073580836673 359.99243330115337 -0.012997209251142885
978.1734916601412 79.09634950402457 359.99037406382115 -0.012674008968996101
468.7130887677887 103.70932107395348 0.006068286014852335 -0.01322360404683915
732.790984782116 114.80235210425441 359.99799208670777 -0.012224549793193257
397.984710427444 124.51324600589399 0.008291256163280063 -0.012770390494991906
453.48648150451567 138.5482319055374 0.006624203827780067 -0.012205946184055615
510.5826324979371 152.64448533976542 0.004908405341258196 -0.011634774691144639
837.2149603482594 177.1785834572367 359.9949499615408 -0.010070545641559236
574.5481104859573 184.43873533137992 0.003027600457347842 -0.010506876620650508
881.0720770864376 205.4811392291359 359.99367911021494 -0.00910047240755286
967.9227669585642 206.66121780659034 359.99101887212703 -0.00884787365368245
403.5962440387207 216.998785601212 0.008354373151629148 -0.00994252422160558
415.2777583527195 223.52829021424284 0.008012874091052141 -0.009713721429904707
489.0920184154513 234.93882953827853 0.005778885460870573 -0.009179436773304156
730.7977037082132 246.70779432945926 359.99839704252184 -0.008216395799283889
495.33441450714344 249.70017562299645 0.005625489983602337 -0.008712222746655486
873.0776664428001 266.42458939825514 359.9940861819049 -0.00726229994756828
741.6867097679047 279.9382786626609 359.99815100970363 -0.007172803098400693
380.14033396361117 301.2436539679342 0.009287748779498183 -0.007423548358097951
665.2235848015512 328.5104074590912 0.0006236098759626848 -0.005872363696826033
721.1009889243013 352.48437128381073 359.99897510732956 -0.004998591785375306
558.8356054855649 391.3900339558093 0.004047855226464509 -0.004203748397144104
456.46867164126957 459.2609164373239 0.0073561127832601925 -0.002371745888469407
689.8327353648502 485.06169266959915 0.00028755014973561054 -0.0009973537094344351
729.3781725739266 495.5207376473076 359.9991061775121 -0.0005793868444065472
421.5313298328499 495.9474141851409 0.00851819173856682 -0.0013308055493282981
694.8390061976295 509.5305205319393 0.00020019156541582563 -0.0002319329312739653
14.081606885276077 557.2166447486212 0.021107528702098505 -0.0005205285248208323
881.6543299915564 595.8568645041335 359.9947254230886 0.0028688929381400895
915.4735869466531 605.5705900525442 359.9937187373024 0.0032461369049492667
996.4781613563033 622.2440029897667 359.9912890038844 0.003944930128583014
794.4678033778682 628.5049053250357 359.99747921198633 0.003667173736498765
840.081104132367 662.8420150991536 359.9961810901739 0.0048294298273538795
481.7458734746978 736.5408482211899 0.007300242502125687 0.006221561579575905
688.4363469452317 768.8245040889547 0.0010937407243143905 0.00772151655478467
981.1057496757138 774.1328899034736 359.99218742384153 0.00856640104398379
786.7033611257062 779.6094428435799 359.99813025456774 0.008285777187910513
500.3213435066071 828.2875623678548 0.006972292739396447 0.009079392487024846
845.1395260116918 888.2486429009447 359.9966490980914 0.011744618340666048
799.9582256550444 894.1529473093893 359.9980397938047 0.011819651703137203
845.956261130645 903.5178548940592 359.99666619433395 0.012212638460852125
835.9945894894588 948.4929444611175 359.99709237310265 0.013561331318791536
1004.5948488048369 950.0992666738197 359.9919654017713 0.013995388320326398
823.5753939434358 959.1642392517674 359.9974990166614 0.013857674611357278
782.0375957577447 960.5590014045085 359.99876499345754 0.013802953255150834
922.1356667374224 978.2850292332223 359.9945543794388 0.014667538039234738
652.6937363556877 1016.2119840128314 0.0028391970295941005 0.015188260679953809
RA_Diff (mas) Dec_diff (mas) pass/fail
-3.623553 -0.168281 pass
0.059981 6.028601 pass
1.980539 -4.873354 pass
-2.866220 0.193737 pass
7.784920 -1.983088 pass
3.634933 -2.891154 pass
-3.193980 -6.285198 pass
-2.836849 -2.974549 pass
-2.909741 -6.499978 pass
-8.133392 1.859597 pass
0.353129 2.226026 pass
1.053862 1.412953 pass
4.254858 9.720189 pass
5.059229 0.811112 pass
3.996774 9.099333 pass
0.709307 4.538448 pass
-0.742303 5.946131 pass
1.029653 1.425431 pass
-2.960956 -1.392640 pass
0.386387 -5.730427 pass
-0.904394 -1.974089 pass
1.343169 8.392748 pass
-3.586016 -3.851537 pass
3.461547 5.235690 pass
7.512148 5.220745 pass
0.873008 -12.378314 pass
-2.074170 1.443758 pass
3.078815 -2.694230 pass
-0.412341 5.627616 pass
1.446377 1.397953 pass
0.229756 -0.032288 pass
1.365980 5.536941 pass
0.324626 -9.252622 pass
-2.683556 -0.802124 pass
0.922188 9.394218 pass
-0.453272 1.002852 pass
2.654289 -10.307142 pass
0.689635 0.241447 pass
1.523119 -7.585423 pass
4.684152 -0.753304 pass
8.988473 -1.648692 pass
-1.836059 2.798112 pass
4.943346 5.312802 pass
0.699602 -1.301541 pass
2.161646 4.044166 pass
3.139657 0.454847 pass
7.353079 5.775123 pass
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits
Image mean, median and std 11.461396 10.8295555 55.684906
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
632.7561014527342 43.52872182023289 0.0008805421841502914 -0.014626439834395417
709.8260670657803 47.5058809583951 359.99852514867274 -0.014311609453108201
910.5951520227544 74.15262735916836 359.99243332955854 -0.012997154434847552
978.1739871993807 79.0963228230719 359.99037404856495 -0.012674008483594294
468.71224848996206 103.70989382247947 0.006068313256945353 -0.013223588820502662
732.7915923131342 114.80647731539594 359.99799207867466 -0.012224423456660083
397.98413357499743 124.51335799099897 0.008291274143771397 -0.012770388542114123
453.486222463101 138.5458169269537 0.006624205620663413 -0.012206020133662565
510.58256909558963 152.6453203832899 0.004908409425163492 -0.011634749468877803
837.2169099602804 177.17912292467238 359.9949499031466 -0.010070524367891584
574.5467924282938 184.53495588155457 0.0030278892909903717 -0.010503947947691706
881.072757297264 205.48539115095912 359.9936791005724 -0.009100341356131934
967.924538456573 206.66197471295982 359.991018819812 -0.00884784623803236
403.59519404561934 216.99772079775687 0.00835440263089767 -0.009942559373896534
415.27622730365823 223.52761937893004 0.008012919319993475 -0.009713745774778241
489.0946428106659 234.93889167070938 0.005778805149752866 -0.009179428285502186
730.7995005378147 246.70662956366752 359.99839698434306 -0.008216426945869442
495.33518932760904 249.7024097932946 0.005625471984489 -0.008712152430070601
873.0774447239464 266.42532686273233 359.9940861906751 -0.007262277967259131
741.6859285461186 279.93870052952946 359.99815103477613 -0.007172792110716809
380.1370486212538 301.2438407112605 0.009287849891110325 -0.007423550962244108
665.2269225901222 328.50792691218294 0.0006235010275023399 -0.005872431596713497
721.1001264694142 352.4851006313926 359.9989751357025 -0.004998571502228098
558.8372234547588 391.38558179923365 0.0040477940412439895 -0.004203881330246453
456.46151568364206 459.25963414936314 0.0073563282770390155 -0.0023718034928518613
689.8318563457915 485.05914533128765 0.00028757019837587086 -0.0009974342669445198
729.3758901700103 495.52228213954953 359.99910625149573 -0.000579344832615903
421.5314421564851 495.9455044748265 0.00851818341899201 -0.001330864069702006
694.837657200127 509.5318564734783 0.00020023640497505223 -0.00023189508643074546
14.081803113089986 557.2159960609778 0.021107521175067694 -0.000520547899563331
881.6523091352415 595.8547570266802 359.994725479002 0.0028688234541196776
915.4741065868286 605.5711695752242 359.9937187230363 0.003246155913113313
996.4784351276294 622.2423567819199 359.9912889908665 0.003944880235320652
794.469839790824 628.5055976724658 359.9974791517016 0.003667199836169508
840.0786466311152 662.8404021273825 359.99618116074055 0.004829374543359347
481.74592656195796 736.5414197031473 0.007300242361110165 0.006221579246730632
688.4356820369527 768.8238940960294 0.0010937593293049244 0.007721496260231114
981.1089672696557 774.1361073647035 359.9921873347029 0.008566506832542512
786.7045617896734 779.611802202087 359.99813022444624 0.008285852281610964
500.32197626807886 828.2892825101978 0.006972277957364353 0.009079446707737027
845.1369459333854 888.244390359914 359.9966491649181 0.011744482514498526
799.9586443996288 894.1555172153749 359.99803978807853 0.011819731140030567
845.9561015097216 903.5187293444774 359.9966662015916 0.012212664779821414
835.9932678302781 948.4906491194473 359.9970924070118 0.013561258281447422
1004.5949500781727 950.1001812322297 359.9919654012403 0.013995416431897886
823.5785927457607 959.1670105496879 359.9974989269903 0.01385776651294443
782.0375591951885 960.5596213741295 359.99876499624685 0.013802972059644389
922.1365503429363 978.2855175769723 359.9945543539023 0.014667554933993935
652.6933028870272 1016.2125890007942 0.0028392117697740244 0.015188278029826733
RA_Diff (mas) Dec_diff (mas) pass/fail
-3.613511 -0.100585 pass
-0.262835 6.359447 pass
2.052714 -5.163361 pass
-2.859766 -0.072481 pass
7.735222 -2.194031 pass
3.725194 -2.851599 pass
-2.418203 -6.492574 pass
-3.053874 -2.880590 pass
-2.939692 -6.710651 pass
-8.066415 1.786537 pass
0.593705 1.737052 pass
1.000647 1.608148 pass
4.286430 9.799318 pass
5.073931 0.901912 pass
3.962061 9.571118 pass
0.762371 4.600907 pass
-0.762917 6.232104 pass
1.127725 1.480246 pass
-2.694615 -1.241397 pass
0.488529 -5.657408 pass
-0.540392 -1.983464 pass
1.465242 8.129813 pass
-3.632881 -4.031153 pass
3.251328 5.312276 pass
7.483229 5.675556 pass
0.872500 -12.314712 pass
-2.395069 1.824597 pass
2.858548 -3.172789 pass
-0.701461 5.658172 pass
1.444465 1.499155 pass
0.174834 -0.030541 pass
1.274048 5.597762 pass
0.578666 -9.451644 pass
-2.791994 -0.531786 pass
0.986918 9.401248 pass
-0.290448 0.915211 pass
2.602931 -10.238713 pass
0.851058 0.377689 pass
1.724407 -7.835565 pass
4.786411 -0.555965 pass
9.151863 -1.583404 pass
-1.900856 3.051252 pass
5.049471 5.186254 pass
0.725730 -1.206793 pass
3.201448 14.587388 pass
2.951323 0.553543 pass
7.143635 5.662995 pass
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits
Image mean, median and std 11.166319 10.819193 52.431835
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
646.9460364189496 123.58824806720995 0.0008803409666353219 -0.01462544759401453
724.0252320146072 127.5820452764259 359.9985251448545 -0.014310524077353
924.8606761687124 154.24326052907645 359.9924329361845 -0.012996383566727537
992.45691902968 159.27374467532363 359.99037339685844 -0.012673064323221303
482.87053476521277 183.28959656865936 0.006068231603246421 -0.013222390879844007
747.0589422960411 194.39222695244513 359.9979919488258 -0.012223096373398978
412.11218706689084 203.90829274053294 0.008291045403339596 -0.012771385160995604
467.56583952342805 217.90372011464456 0.00662635936109802 -0.01220484372594049
524.7770858845939 231.89311550157834 0.0049079203445831455 -0.011633826109081785
851.5364944961776 256.5001400819646 359.99495137802734 -0.010069281024660396
588.705062769309 263.51085726272504 0.0030296502371099806 -0.010506455620478956
895.4584259369747 284.53409875070355 359.99367964554193 -0.0091047589609821
982.4255461949168 285.9202146860721 359.99101719217686 -0.008849400351720169
417.7174017858739 295.82945696890056 0.008353917643836436 -0.009945222372284788
429.4042633190108 302.3938491302124 0.008012662027330593 -0.009714355847956803
503.2698996261898 313.66457227896325 0.005778574588179 -0.009182449351832687
745.2283576279594 325.5350018038381 359.99839492246144 -0.008217355359381432
509.53867989539395 328.42412505899017 0.005624735426441953 -0.008713537241315246
887.5443812545439 345.2641690333635 359.9940862878344 -0.007265244786619
756.1049685736115 358.67865141799314 359.9981503199985 -0.00717342350491229
394.23291927272953 379.85017585787546 0.009287587812766219 -0.00742439167826378
679.5634066559268 407.0596025804446 0.0006242027742464089 -0.005873736972104611
735.4844061261805 431.0996831560591 359.99897662127745 -0.0049976416161509035
573.1313058171473 469.80286113326713 0.004047329109084021 -0.004205179593319682
470.5890419719976 537.6340474457602 0.007357930444448098 -0.00237327401915634
704.327058625501 563.4788329832742 0.00028666582563447254 -0.0009992064146646443
435.6105785039881 574.3863481872331 0.008520331771738035 -0.0013305748801799543
743.874891664683 573.9747828254133 359.9991067931344 -0.0005809777008637135
709.3557006099318 587.9666594324468 0.0001991739613351785 -0.00023358941671565873
27.531278375167513 635.8512293053622 0.021115014317358988 -0.0005216216890524824
896.4408422838092 674.4980277163539 359.99472377077933 0.0028676799548390266
930.3046944886573 684.334662079809 359.9937171097069 0.0032476367453057745
1011.3109434871345 701.0321927252717 359.99128955084143 0.003944579315404069
809.095857702636 707.1484044619239 359.99747998772455 0.0036660735530476296
854.7864857555858 741.5832025222157 359.99618146318284 0.0048288846011218705
496.042646678495 815.501330316961 0.00730043085322982 0.006226567438309456
702.974834779573 847.7555655541388 0.0010946992939119733 0.007721763324996789
995.9743233516383 853.1699976082482 359.9921875269867 0.008566666045003165
801.4327560408036 858.5945248989527 359.9981289789841 0.008286199706369223
514.6244381546285 907.3352544164048 0.006973482959273866 0.009079930104721341
859.8694947178157 967.5204508513665 359.99664969864597 0.011745747050078564
814.6347535333018 973.4206873951758 359.99804066679786 0.011820395007652196
860.6853482064994 982.8172971910304 359.9966667541225 0.01221360129934576
RA_Diff (mas) Dec_diff (mas) pass/fail
-1.203028 -11.543093 pass
4.893700 4.162587 pass
7.721476 1.713322 pass
1.151995 -5.124618 pass
3.349600 -11.786469 pass
-0.044192 -6.935209 pass
4.794378 -5.669569 pass
-4.682542 2.747970 pass
2.515126 6.289380 pass
5.338653 3.348377 pass
4.636204 -0.881232 pass
3.313240 4.226007 pass
5.923951 -6.332260 pass
2.400472 8.622028 pass
0.833772 5.792833 pass
-0.744716 -7.119723 pass
5.836599 -2.309818 pass
-1.483874 -5.010042 pass
-1.616971 -5.114465 pass
8.560898 9.788311 pass
7.015773 10.453056 pass
1.551072 5.642778 pass
-1.702848 2.397762 pass
1.184793 -7.846536 pass
-1.531483 -5.217667 pass
-2.171310 3.368436 pass
1.667458 -11.215436 pass
-7.275657 0.718943 pass
0.163452 5.813420 pass
-1.216702 -1.281053 pass
-3.205055 -4.907717 pass
-2.973739 -5.721900 pass
-4.425194 -11.952163 pass
3.370264 2.219160 pass
8.427480 1.988662 pass
-4.552465 -1.934069 pass
3.303518 -4.400540 pass
2.714841 2.164678 pass
9.540854 5.559766 pass
-2.908163 -5.041266 pass
-0.279139 2.320706 pass
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits
Image mean, median and std 11.167205 10.820021 52.420555
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
646.9454800415763 123.59122321380107 0.0008803656879164385 -0.014625358834867506
724.0256726768248 127.58013796160934 359.9985251264132 -0.01431058074881553
924.8597080043684 154.2432706124099 359.99243296590157 -0.012996385708730001
992.4534255006282 159.2718625921307 359.9903734990552 -0.012673130090554478
482.8696673425391 183.2899835191299 0.006068259202637669 -0.013222381265036554
747.0578849106864 194.39226082259032 359.9979919813537 -0.012223097981552028
412.1139269048188 203.90945048821695 0.00829099500464183 -0.012771345469780142
467.56675428766414 217.9036290726527 0.0066263310760417415 -0.01220484420928609
524.7779965210373 231.88761492892587 0.004907878219448835 -0.011633991987964873
851.5351015628255 256.50133330428804 359.9949514239217 -0.010069248022576957
588.7056787681511 263.50878787844727 0.003029625957239504 -0.01050651745401577
895.4613105651895 284.53301855679746 359.9936795541991 -0.009104784903560181
982.4265095675484 285.9188137972235 359.99101715886314 -0.008849440744045681
417.71543674308754 295.8303503510455 0.008353980132200288 -0.00994519994298999
429.4043006594748 302.391294319142 0.008012654340806747 -0.009714434124611955
503.2701695686526 313.660954522638 0.005778556956879143 -0.009182559722200206
745.227175719965 325.53650613651814 359.99839496270187 -0.008217312112789378
509.5395129140925 328.4264116852812 0.005624715832518511 -0.008713464923489102
887.5432061951202 345.2660055868902 359.9940863288323 -0.007265191349839529
756.1041842849181 358.6800425484636 359.9981503477614 -0.007173382702703706
394.23237537998807 379.85139546326104 0.009287607567243169 -0.007424355561664159
679.5646720105382 407.0614691793956 0.0006241690117001846 -0.0058736764496161555
735.4846227401789 431.0987984975643 359.99897661226294 -0.004997668302282632
573.1327307968371 469.8028377674046 0.004047285469453377 -0.004205176771126612
470.5899109886719 537.634139560142 0.007357904143361665 -0.0023732689841836083
704.3299938731695 563.4795835368527 0.00028657817169840187 -0.0009991762174390486
435.6099546323682 574.3867880651862 0.008520351938341926 -0.0013305629301788556
743.876859351675 573.9722780891316 359.99910672620973 -0.000581050034878793
709.353752512589 587.9671313943018 0.00019923473444689437 -0.0002335795982129045
27.528381239185606 635.852642005663 0.021115105964276147 -0.0005215862798103629
896.4397012609306 674.5007838620852 359.9947238133093 0.002867761902645875
930.3064781430503 684.334060840617 359.9937170535473 0.003247622400811566
1011.3112434924527 701.0314437239015 359.99128953955324 0.003944557036107322
809.0957248208425 707.1478396927572 359.99747999022435 0.003666055911212994
854.7882520124947 741.5815247429309 359.99618140466794 0.004828837272518164
496.0419398685006 815.5016620469418 0.007300453193028751 0.0062265758102119555
702.9741875563504 847.7562918805631 0.0010947209288824965 0.007721783980913229
995.9721439659877 853.1689695028363 359.99218759056447 0.008566629720873442
801.4316652320226 858.5921814993368 359.9981290057719 0.008286125536795407
514.6267263594901 907.3369596675094 0.00697341792737487 0.009079987884410582
859.8707171877863 967.5196606903338 359.99664965931487 0.011745725802043364
814.6354876594828 973.4205911145488 359.99804064422983 0.011820393789056067
860.6851506594377 982.8162979189045 359.99666675739485 0.012213570408960222
RA_Diff (mas) Dec_diff (mas) pass/fail
-1.518582 -11.434383 pass
4.791874 4.160847 pass
7.655088 1.509304 pass
1.251941 -4.977730 pass
3.254916 -11.768343 pass
-0.035192 -6.998720 pass
4.866978 -5.626549 pass
-4.604656 2.822331 pass
2.373534 6.212887 pass
5.104539 3.556384 pass
4.783796 -0.688859 pass
3.161590 3.628843 pass
5.595117 -6.425653 pass
2.319227 8.617641 pass
0.933129 5.827446 pass
-0.985645 -7.380126 pass
5.804147 -2.405888 pass
-1.412758 -4.880022 pass
-1.657608 -5.194670 pass
8.726118 9.907119 pass
7.132873 10.447266 pass
1.631495 5.672917 pass
-1.473968 2.266995 pass
1.027690 -7.836376 pass
-1.594955 -5.615000 pass
-1.803401 3.131674 pass
1.456805 -11.385819 pass
-7.179221 0.451932 pass
-0.017983 5.956309 pass
-1.244373 -1.562849 pass
-3.407230 -4.959357 pass
-2.754956 -5.686554 pass
-4.272087 -11.657150 pass
3.477246 2.211449 pass
8.516476 2.308194 pass
-4.623003 -1.673725 pass
3.528476 -4.319795 pass
2.726621 2.053472 pass
9.453446 5.337166 pass
-3.028093 -5.186679 pass
-0.134273 2.476394 pass
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits
Image mean, median and std 11.14942 10.819677 52.3238
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
695.2882988999536 103.10651467532003 0.0008800008772832899 -0.014624813910079982
772.3744183009295 107.0815682195305 359.9985245931245 -0.014309869787115948
973.228381685913 133.63302595063803 359.99243224223216 -0.012997673379714877
531.2457880501139 162.90678044840305 0.006067753827247839 -0.013222863142923662
795.4098654036351 173.99541287004112 359.9979911433319 -0.012223925183360086
460.547711377863 183.5249036196875 0.008289441834595316 -0.012772358696295038
515.9706963233565 197.55498823067623 0.006625409028767752 -0.012205661433268716
573.1045796641623 211.60813499707166 0.004909149394200925 -0.01163371221201762
899.8933788590772 236.19645940742822 359.9949503013732 -0.010070332329877986
637.0838241772371 243.32047754138887 0.00302930239325246 -0.010504872055279972
943.8044405646633 264.45023347848417 359.9936793323863 -0.009100426256506654
466.16761385963326 275.6415362787146 0.008353364238678336 -0.00994304344948607
477.7998425311254 282.12836328156897 0.008013547610210205 -0.009714975271219643
551.6424228064568 293.5141692246144 0.005779824893848046 -0.009180675245526442
793.5362941129501 305.3737976889193 359.99839615145964 -0.008218045255784857
557.9115612743607 308.2309333789397 0.005626000043587533 -0.008713509112374706
935.89818015132 325.1387934464577 359.9940855059957 -0.00726544155060442
804.4990143921109 338.5651047740593 359.9981491833879 -0.0071737216779422215
442.6930855595648 359.6109073627168 0.009288286507927042 -0.007424822264389844
727.9952424701189 386.98027318926063 0.0006232392478226067 -0.005873735036980789
783.9187945939353 411.06018073336685 359.9989753985937 -0.00499750078331377
621.5759401883365 449.7014536319138 0.00404829003612404 -0.004205284148308415
519.1902540839886 517.5298630654247 0.007357057943188697 -0.002371136402893473
752.7897384965033 543.479054423098 0.00028734675743388586 -0.0009989984751563358
484.25480678313863 554.161793091394 0.008519257795758167 -0.001330984310451842
792.3715451848047 553.9949623101498 359.9991060833142 -0.0005807988134908488
757.8281459003109 567.9717563455148 0.00019999925135859084 -0.0002333580126112227
396.18338983138534 604.5780857775677 0.01133613097965103 -3.5146940737205506e-06
76.35854360332827 615.2713546165651 0.021113604528003087 -0.0005212509629759039
944.8620518533836 654.6300422676247 359.9947249668796 0.0028684712215900337
978.7199582266016 664.4764120134141 359.9937180442408 0.00324823477261302
857.5978321036471 687.1863850362278 359.9974808060295 0.0036657619234262495
903.3383272720531 721.6639082807033 359.99618069821037 0.004829340458761752
544.822969770774 795.1767613387013 0.007300501536278909 0.00622535560971207
751.6593136994991 827.6341518190358 0.0010951813293202872 0.0077212194450194584
850.0297444326784 838.5511439029677 359.99813041047923 0.008285502452127409
563.5070365304637 886.9914021805405 0.006972577193303109 0.009079660723682728
908.5174896745665 947.4667033713542 359.99665071218845 0.01174530799753924
863.3821582485261 953.31539644542 359.99803984272904 0.011819834480523251
909.4201911354062 962.7615722742491 359.9966654557789 0.012213561507437893
899.4889080888873 1007.7029930107033 359.9970911156624 0.013559580759199472
845.5160643327326 1019.3354165427019 359.9987631926184 0.0137889507124076
887.0452334515168 1018.3645917674779 359.9974986040853 0.013855459901527773
RA_Diff (mas) Dec_diff (mas) pass/fail
-1.425293 -1.944355 pass
1.248327 -10.794511 pass
1.472504 1.218840 pass
5.735248 4.068766 pass
-2.939804 -6.198041 pass
0.208595 -4.091050 pass
2.901706 -8.057076 pass
0.928065 -7.143518 pass
-2.947214 0.790002 pass
6.163878 4.708791 pass
2.077896 2.378605 pass
1.821585 -1.589582 pass
7.737819 4.636037 pass
4.796591 9.265477 pass
-0.566175 6.604130 pass
-0.886222 4.092685 pass
-3.300069 -6.475729 pass
1.434937 -1.802820 pass
1.031429 -6.560152 pass
-3.183615 2.090733 pass
4.684943 6.003612 pass
4.115995 7.469340 pass
1.805531 1.280195 pass
4.644130 -8.222934 pass
2.969618 1.169116 pass
-1.086443 -9.574348 pass
-2.122275 -1.791172 pass
-5.609395 2.308693 pass
1.971397 -3.510976 pass
0.159267 -2.754819 pass
-0.002695 -4.888845 pass
-0.119234 -9.103602 pass
0.872036 -2.424167 pass
7.203158 4.269924 pass
0.000157 -1.832805 pass
1.311259 3.443582 pass
-1.959196 2.021427 pass
8.288616 11.260601 pass
4.145255 -0.162921 pass
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits
Image mean, median and std 11.148314 10.819933 52.31703
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
695.28794170584 103.10641319490699 0.0008800115795231863 -0.01462481787900968
772.3731936505352 107.08007937646431 359.9985246268782 -0.014309917872403828
973.2281832908834 133.6348268676595 359.992432252969 -0.012997619538201288
531.2461240972619 162.90616024026545 0.006067741924447004 -0.013222881168460607
795.4082883628598 173.9964145346605 359.99799119432987 -0.01222389869223297
460.5482539991836 183.52565213354322 0.008289427105149128 -0.012772334529918135
515.971022928771 197.55386309448286 0.006625396116303293 -0.012205694933804823
573.1055169320389 211.6075876893692 0.0049091192277255415 -0.011633726576394846
899.8952017510751 236.19527724644132 359.99495024232874 -0.010070363843153046
637.082904882704 243.32193769850684 0.003029334402767267 -0.01050482968984714
943.7992653146599 264.4489310792786 359.99367948756526 -0.009100478721790392
466.1660535560782 275.640950154766 0.008353410553245011 -0.009943065336091812
477.79796528347913 282.1275102677306 0.008013602946853783 -0.009715006139339866
551.6441749526855 293.5150245290313 0.005779773415525509 -0.009180644632308558
793.5314353855134 305.37140487562107 359.9983962940064 -0.00821813048577351
557.9109575174925 308.23135130802393 0.005626019634737101 -0.008713497795483575
935.8973036748098 325.14009061951293 359.9940855363827 -0.007265403985229679
804.4988427398484 338.56293884484654 359.9981491828204 -0.007173788531946998
442.6927137354523 359.6114345294081 0.009288299245937747 -0.007424807000506554
727.9943724390052 386.9821714885887 0.0006232709857077299 -0.005873678813221203
783.9162233378428 411.0579407438311 359.9989754712712 -0.004997575863914036
621.5767698477409 449.70199238928535 0.004048266080364153 -0.004205265514444473
519.1911503353462 517.5358092205225 0.0073570460586275645 -0.0023709510343529468
752.7880780342024 543.4801203561428 0.0002874004121121975 -0.000998969663921725
484.25376556038856 554.1619772165304 0.00851929006313443 -0.0013309812693040395
792.3751873690417 553.9946415511126 359.9991059710994 -0.0005808000012685225
757.8304438957533 567.9695819856329 0.00019992310895048133 -0.0002334194004333699
396.18468311561935 604.5807611777432 0.011336098337038783 -3.429058731243893e-06
76.35814999540862 615.2723711714851 0.02111361895637598 -0.0005212208222102637
944.8635640932658 654.6310144514106 359.99472492340107 0.0028685045368420587
978.7205619653042 664.4790452486839 359.99371803321566 0.003248316935449173
857.5958244646582 687.1827860653182 359.9974808573291 0.0036656467929251264
903.3399724466342 721.6604165017714 359.99618063825375 0.004829237186174471
544.8233340592824 795.1777717322748 0.007300493096006179 0.006225387462063048
751.6584803677636 827.6363909001989 0.0010952127669043958 0.007721285965960717
850.0294380306964 838.55150947549 359.9981304208188 0.008285512920257644
563.5067284206251 886.9918823123108 0.006972587803690846 0.00907967462159978
908.5206742421236 947.4677816020749 359.9966506182584 0.01174534815537037
863.3827492499984 953.3136639288376 359.99803982000446 0.011819783039594491
909.4171471081825 962.7581389765916 359.99666553892456 0.012213449914027643
899.4888297651883 1007.7051953534469 359.99709112408334 0.013559647619545423
845.5162351428138 1019.3362542119728 359.99876318970763 0.013788976596931363
887.044887942196 1018.3648827073387 359.997498615383 0.01385546795957044
RA_Diff (mas) Dec_diff (mas) pass/fail
-1.384621 -1.915346 pass
1.441484 -10.690790 pass
1.426019 1.098238 pass
5.856762 3.895659 pass
-2.941847 -6.438715 pass
0.165811 -3.423724 pass
3.086385 -8.471545 pass
1.044227 -7.132569 pass
-2.834039 1.029477 pass
5.825730 4.853359 pass
2.116093 2.428638 pass
1.930978 -1.454347 pass
7.629220 4.584325 pass
5.355235 9.076602 pass
-0.647984 6.418943 pass
-0.929072 4.027794 pass
-3.704042 -6.480005 pass
1.696576 -2.073110 pass
1.077285 -6.505202 pass
-3.153300 2.331430 pass
4.472383 5.890165 pass
4.299587 7.564708 pass
1.775146 1.394863 pass
4.557889 -8.155852 pass
2.784296 1.279324 pass
-1.302286 -9.946130 pass
-2.085052 -1.753487 pass
-5.662421 2.395692 pass
2.170609 -3.622102 pass
0.119576 -2.459032 pass
-0.276808 -5.109842 pass
-0.275756 -8.983667 pass
0.910688 -2.230338 pass
7.241686 4.255636 pass
0.070685 -1.792064 pass
1.477992 3.364790 pass
-1.659872 1.619690 pass
8.403850 11.413117 pass
4.658423 -0.469749 pass
RA difference mean, median and std (units in mas) 1.1037660880047775 0.9281835036028911 3.549202125823858 Dec difference mean, median and std (units in mas) -0.06135758681286737 1.0161649008182116 5.550928948928192
Alter any parameters needed to get better results from tweakreg. Look at individual i2d images afterwards.
# use asn_from_list to create association table
#calfiles = glob.glob('starfield*_cal.fits')
asn = asn_from_list.asn_from_list(imagelist, rule=DMS_Level3_Base, product_name='starfield_50star4ptdither_combined.fits')
# use this if you need to add non'science' exposure types
#asn['products'][0]['members'][1]['exptype'] = 'background'
#asn['products'][0]['members'][2]['exptype'] = 'sourcecat'
# dump association table to a .json file for use in image3
with open('starfield_50star4ptdither_asnfile.json', 'w') as fp:
fp.write(asn.dump()[1])
print(asn)
jwnoprogram-a3001_none_010_asn with 1 products Rule=DMS_Level3_Base No constraints Products: starfield_50star4ptdither_combined.fits with 8 members
# Run Calwebb_image3 on the association table with tweakreg on
# set any specific parameters
# tweakreg parameters to allow data to run
fwhm = 3.318 #3.27 # Gaussian kernel FWHM of objects expected, default=2.5
minobj = 5 # minimum number of objects needed to match positions for a good fit, default=15
snr = 40 # signal to noise threshold, default=5
sigma = 3 # clipping limit, in sigma units, used when performing fit, default=3
fit_geom ='rshift' # ftype of affine transformation to be considered when fitting catalogs, default='general'
use2dhist = False # boolean indicating whether to use 2D histogram to find initial offset, default=True
pipe3=Image3Pipeline()
pipe3.tweakreg.kernel_fwhm = fwhm
pipe3.tweakreg.snr_threshold = snr
pipe3.tweakreg.minobj = minobj
pipe3.tweakreg.sigma = sigma
pipe3.tweakreg.fitgeometry = fit_geom
pipe3.tweakreg.use2dhist = use2dhist
pipe3.tweakreg.save_catalogs = True
#pipe3.tweakreg.skip = True # test to see if this affects the final output
pipe3.outlier_detection.skip = True # this is set in later step so mis-alignments aren't 'hidden'
pipe3.outlier_detection.skip = True
pipe3.source_catalog.save_results = True
pipe3.save_results = True
#pipe3.output_dir = datadir
# run Image3
#im = pipe3.run(rtdata.input)
image = pipe3.run('starfield_50star4ptdither_asnfile.json')
print('Image 3 pipeline finished.')
2021-10-30 15:32:39,491 - stpipe.Image3Pipeline - INFO - Image3Pipeline instance created.
2021-10-30 15:32:39,493 - stpipe.Image3Pipeline.assign_mtwcs - INFO - AssignMTWcsStep instance created.
2021-10-30 15:32:39,495 - stpipe.Image3Pipeline.tweakreg - INFO - TweakRegStep instance created.
2021-10-30 15:32:39,497 - stpipe.Image3Pipeline.skymatch - INFO - SkyMatchStep instance created.
2021-10-30 15:32:39,499 - stpipe.Image3Pipeline.outlier_detection - INFO - OutlierDetectionStep instance created.
2021-10-30 15:32:39,500 - stpipe.Image3Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:32:39,501 - stpipe.Image3Pipeline.source_catalog - INFO - SourceCatalogStep instance created.
2021-10-30 15:32:39,626 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline running with args ('starfield_50star4ptdither_asnfile.json',).
2021-10-30 15:32:39,633 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'steps': {'assign_mtwcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'assign_mtwcs', 'search_output_file': True, 'input_dir': ''}, 'tweakreg': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': True, 'catalog_format': 'ecsv', 'kernel_fwhm': 3.318, 'snr_threshold': 40, 'brightest': 1000, 'peakmax': None, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 1.0, 'use2dhist': False, 'separation': 0.5, 'tolerance': 1.0, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'rshift', 'nclip': 3, 'sigma': 3, 'align_to_gaia': False, 'gaia_catalog': 'GAIADR2', 'min_gaia': 5, 'save_gaia_catalog': False}, 'skymatch': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'global+match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '0', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}, 'outlier_detection': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}, 'source_catalog': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 100, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 5, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}}}
2021-10-30 15:32:39,733 - stpipe.Image3Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits' reftypes = ['abvegaoffset', 'apcorr', 'drizpars']
2021-10-30 15:32:39,741 - stpipe.Image3Pipeline - INFO - Prefetch for ABVEGAOFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf'.
2021-10-30 15:32:39,743 - stpipe.Image3Pipeline - INFO - Prefetch for APCORR reference file is '/grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits'.
2021-10-30 15:32:39,745 - stpipe.Image3Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:32:39,747 - stpipe.Image3Pipeline - INFO - Starting calwebb_image3 ...
2021-10-30 15:32:40,601 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg running with args (<ModelContainer>,).
2021-10-30 15:32:40,604 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': True, 'catalog_format': 'ecsv', 'kernel_fwhm': 3.318, 'snr_threshold': 40, 'brightest': 1000, 'peakmax': None, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 1.0, 'use2dhist': False, 'separation': 0.5, 'tolerance': 1.0, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'rshift', 'nclip': 3, 'sigma': 3, 'align_to_gaia': False, 'gaia_catalog': 'GAIADR2', 'min_gaia': 5, 'save_gaia_catalog': False}
2021-10-30 15:32:40,838 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 48 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits.
2021-10-30 15:32:40,843 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal_cat.ecsv
2021-10-30 15:32:41,096 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 48 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits.
2021-10-30 15:32:41,099 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal_cat.ecsv
2021-10-30 15:32:41,341 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 49 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits.
2021-10-30 15:32:41,345 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal_cat.ecsv
2021-10-30 15:32:41,606 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 48 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits.
2021-10-30 15:32:41,609 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal_cat.ecsv
2021-10-30 15:32:41,853 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 42 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits.
2021-10-30 15:32:41,856 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal_cat.ecsv
2021-10-30 15:32:42,110 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 42 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits.
2021-10-30 15:32:42,113 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal_cat.ecsv
2021-10-30 15:32:42,371 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 43 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits.
2021-10-30 15:32:42,375 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal_cat.ecsv
2021-10-30 15:32:42,609 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 42 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits.
2021-10-30 15:32:42,613 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal_cat.ecsv
2021-10-30 15:32:42,632 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:42,633 - stpipe.Image3Pipeline.tweakreg - INFO - Number of image groups to be aligned: 8.
2021-10-30 15:32:42,634 - stpipe.Image3Pipeline.tweakreg - INFO - Image groups:
2021-10-30 15:32:42,659 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal':
2021-10-30 15:32:42,660 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal
2021-10-30 15:32:42,683 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal':
2021-10-30 15:32:42,684 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal
2021-10-30 15:32:42,709 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal':
2021-10-30 15:32:42,709 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal
2021-10-30 15:32:42,734 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal':
2021-10-30 15:32:42,734 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal
2021-10-30 15:32:42,758 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal':
2021-10-30 15:32:42,759 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal
2021-10-30 15:32:42,783 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal':
2021-10-30 15:32:42,784 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal
2021-10-30 15:32:42,808 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal':
2021-10-30 15:32:42,808 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal
2021-10-30 15:32:42,832 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal':
2021-10-30 15:32:42,833 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal
2021-10-30 15:32:42,833 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:42,834 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:42,834 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() started on 2021-10-30 15:32:42.834417
2021-10-30 15:32:42,835 - stpipe.Image3Pipeline.tweakreg - INFO - Version 0.7.3
2021-10-30 15:32:42,836 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:42,993 - stpipe.Image3Pipeline.tweakreg - INFO - Selected image 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' as reference image
2021-10-30 15:32:42,997 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2021-10-30 15:32:43,101 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:32:43,103 - stpipe.Image3Pipeline.tweakreg - INFO - Found 48 matches for 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal'...
2021-10-30 15:32:43,104 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:32:43,106 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal:
2021-10-30 15:32:43,107 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -4.99872e-05 YSH: -1.34437e-05 ROT: 5.32927e-05 SCALE: 1
2021-10-30 15:32:43,107 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:43,108 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.000287318 FIT MAE: 0.000256544
2021-10-30 15:32:43,108 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 48 objects.
2021-10-30 15:32:43,138 - stpipe.Image3Pipeline.tweakreg - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/wcs.py:1990: DeprecationWarning: Indexing a WCS.pipeline step is deprecated. Use the `frame` and `transform` attributes instead.
warnings.warn("Indexing a WCS.pipeline step is deprecated. "
2021-10-30 15:32:43,152 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2021-10-30 15:32:43,263 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:32:43,264 - stpipe.Image3Pipeline.tweakreg - INFO - Found 47 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal'...
2021-10-30 15:32:43,265 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:32:43,268 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal:
2021-10-30 15:32:43,268 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000321171 YSH: -4.24579e-05 ROT: -0.000894824 SCALE: 1
2021-10-30 15:32:43,269 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:43,269 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.00527931 FIT MAE: 0.00461642
2021-10-30 15:32:43,270 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 46 objects.
2021-10-30 15:32:43,309 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2021-10-30 15:32:43,417 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:32:43,419 - stpipe.Image3Pipeline.tweakreg - INFO - Found 47 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal'...
2021-10-30 15:32:43,420 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:32:43,423 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal:
2021-10-30 15:32:43,424 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000338653 YSH: -0.000284604 ROT: -0.000801054 SCALE: 1
2021-10-30 15:32:43,424 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:43,425 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.00545887 FIT MAE: 0.00479425
2021-10-30 15:32:43,425 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 46 objects.
2021-10-30 15:32:43,621 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2021-10-30 15:32:43,720 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:32:43,722 - stpipe.Image3Pipeline.tweakreg - INFO - Found 41 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal'...
2021-10-30 15:32:43,723 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:32:43,725 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal:
2021-10-30 15:32:43,726 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000303586 YSH: 0.00105847 ROT: -0.000552349 SCALE: 1
2021-10-30 15:32:43,727 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:43,727 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.00771548 FIT MAE: 0.00684298
2021-10-30 15:32:43,728 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 40 objects.
2021-10-30 15:32:43,766 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2021-10-30 15:32:43,865 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:32:43,866 - stpipe.Image3Pipeline.tweakreg - INFO - Found 41 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal'...
2021-10-30 15:32:43,867 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:32:43,870 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal:
2021-10-30 15:32:43,870 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000286148 YSH: 0.00108692 ROT: -0.000523678 SCALE: 1
2021-10-30 15:32:43,871 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:43,871 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.00770516 FIT MAE: 0.00682456
2021-10-30 15:32:43,872 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 40 objects.
2021-10-30 15:32:43,911 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2021-10-30 15:32:44,017 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:32:44,019 - stpipe.Image3Pipeline.tweakreg - INFO - Found 40 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal'...
2021-10-30 15:32:44,020 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:32:44,023 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal:
2021-10-30 15:32:44,023 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000237614 YSH: 0.00262767 ROT: 0.000387146 SCALE: 1
2021-10-30 15:32:44,024 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:44,025 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.0110158 FIT MAE: 0.0068922
2021-10-30 15:32:44,025 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 39 objects.
2021-10-30 15:32:44,064 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2021-10-30 15:32:44,170 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:32:44,172 - stpipe.Image3Pipeline.tweakreg - INFO - Found 40 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal'...
2021-10-30 15:32:44,172 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:32:44,175 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal:
2021-10-30 15:32:44,176 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000265638 YSH: 0.00262238 ROT: 0.000458858 SCALE: 1
2021-10-30 15:32:44,177 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:44,177 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.0110242 FIT MAE: 0.00691673
2021-10-30 15:32:44,178 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 39 objects.
2021-10-30 15:32:44,217 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:44,218 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() ended on 2021-10-30 15:32:44.217225
2021-10-30 15:32:44,218 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() TOTAL RUN TIME: 0:00:01.382808
2021-10-30 15:32:44,219 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:32:44,522 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg done
2021-10-30 15:32:44,705 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch running with args (<ModelContainer>,).
2021-10-30 15:32:44,708 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'global+match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '0', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}
2021-10-30 15:32:44,767 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:32:44,768 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() started on 2021-10-30 15:32:44.767805
2021-10-30 15:32:44,769 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:32:44,770 - stpipe.Image3Pipeline.skymatch - INFO - Sky computation method: 'global+match'
2021-10-30 15:32:44,770 - stpipe.Image3Pipeline.skymatch - INFO - Sky matching direction: DOWN
2021-10-30 15:32:44,771 - stpipe.Image3Pipeline.skymatch - INFO - Sky subtraction from image data: OFF
2021-10-30 15:32:44,771 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:32:44,772 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing differences in sky values in overlapping regions.
2021-10-30 15:32:51,613 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0109372
2021-10-30 15:32:51,615 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.022236
2021-10-30 15:32:51,616 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0132933
2021-10-30 15:32:51,616 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00937814
2021-10-30 15:32:51,617 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0
2021-10-30 15:32:51,617 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00884242
2021-10-30 15:32:51,618 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00383076
2021-10-30 15:32:51,619 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0136089
2021-10-30 15:32:51,619 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:32:51,620 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing "global" sky - smallest sky value across *all* input images.
2021-10-30 15:32:51,781 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:32:51,782 - stpipe.Image3Pipeline.skymatch - INFO - "Global" sky value correction: 10.812714931864468 [not converted]
2021-10-30 15:32:51,783 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:32:51,783 - stpipe.Image3Pipeline.skymatch - INFO - ---- Final (match+global) sky for:
2021-10-30 15:32:51,784 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8237 (old=0.0109372, delta=10.8127)
2021-10-30 15:32:51,785 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.835 (old=0.022236, delta=10.8127)
2021-10-30 15:32:51,785 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.826 (old=0.0132933, delta=10.8127)
2021-10-30 15:32:51,786 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8221 (old=0.00937814, delta=10.8127)
2021-10-30 15:32:51,786 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8127 (old=0, delta=10.8127)
2021-10-30 15:32:51,787 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8216 (old=0.00884242, delta=10.8127)
2021-10-30 15:32:51,788 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8165 (old=0.00383076, delta=10.8127)
2021-10-30 15:32:51,788 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8263 (old=0.0136089, delta=10.8127)
2021-10-30 15:32:51,789 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:32:51,789 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() ended on 2021-10-30 15:32:51.789219
2021-10-30 15:32:51,790 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() TOTAL RUN TIME: 0:00:07.021414
2021-10-30 15:32:51,790 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:32:51,803 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch done
2021-10-30 15:32:51,941 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection running with args (<ModelContainer>,).
2021-10-30 15:32:51,944 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None}
2021-10-30 15:32:51,944 - stpipe.Image3Pipeline.outlier_detection - INFO - Step skipped.
2021-10-30 15:32:51,949 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection done
2021-10-30 15:32:52,062 - stpipe.Image3Pipeline.resample - INFO - Step resample running with args (<ModelContainer>,).
2021-10-30 15:32:52,064 - stpipe.Image3Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:32:52,079 - stpipe.Image3Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:32:52,255 - stpipe.Image3Pipeline.resample - INFO - Blending metadata for starfield_50star4ptdither_combined.fits
2021-10-30 15:32:52,828 - stpipe.Image3Pipeline.resample - INFO - Resampling science data
2021-10-30 15:32:53,573 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:32:55,037 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:32:56,403 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:32:57,737 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:32:59,119 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:00,474 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:01,952 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:03,287 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:03,837 - stpipe.Image3Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:33:04,519 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:05,817 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:07,114 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:08,454 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:09,821 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:11,205 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:12,609 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:13,959 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:14,496 - stpipe.Image3Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:33:15,098 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:16,482 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:17,868 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:19,227 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:20,617 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:22,017 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:23,403 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:24,753 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:25,283 - stpipe.Image3Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:33:25,934 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:27,347 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:28,785 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:30,305 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:31,805 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:33,273 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:34,725 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:36,177 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:33:36,728 - stpipe.Image3Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:33:36,731 - stpipe.Image3Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021512893 -0.020377290 0.024586045 0.014642008 359.990548023 0.017629048 359.987474870 -0.017390249
2021-10-30 15:33:37,148 - stpipe.Image3Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_combined_i2d.fits
2021-10-30 15:33:37,149 - stpipe.Image3Pipeline.resample - INFO - Step resample done
2021-10-30 15:33:37,326 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog running with args (<ImageModel(1142, 1111) from starfield_50star4ptdither_combined_i2d.fits>,).
2021-10-30 15:33:37,329 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 100, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 5, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}
2021-10-30 15:33:37,351 - stpipe.Image3Pipeline.source_catalog - INFO - Using APCORR reference file /grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits
2021-10-30 15:33:37,360 - stpipe.Image3Pipeline.source_catalog - INFO - Using ABVEGAOFFSET reference file /grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf
2021-10-30 15:33:37,362 - stpipe.Image3Pipeline.source_catalog - INFO - Instrument: MIRI
2021-10-30 15:33:37,363 - stpipe.Image3Pipeline.source_catalog - INFO - Detector: MIRIMAGE
2021-10-30 15:33:37,364 - stpipe.Image3Pipeline.source_catalog - INFO - Filter: F1130W
2021-10-30 15:33:37,365 - stpipe.Image3Pipeline.source_catalog - INFO - Subarray: FULL
2021-10-30 15:33:37,406 - stpipe.Image3Pipeline.source_catalog - INFO - AB to Vega magnitude offset 5.49349
2021-10-30 15:33:37,846 - stpipe.Image3Pipeline.source_catalog - INFO - Detected 665 sources
2021-10-30 15:33:38,549 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote source catalog: starfield_50star4ptdither_combined_cat.ecsv
2021-10-30 15:33:38,647 - stpipe.Image3Pipeline.source_catalog - INFO - Saved model in starfield_50star4ptdither_combined_segm.fits
2021-10-30 15:33:38,650 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote segmentation map: starfield_50star4ptdither_combined_segm.fits
2021-10-30 15:33:38,652 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog done
2021-10-30 15:33:38,654 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline done
Image 3 pipeline finished.
# Get list of catalogs
cataloglist = [ele.replace('cal.fits', 'cal_cat.ecsv') for ele in imagelist]
print(imagelist)
print()
print(cataloglist)
['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits'] ['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal_cat.ecsv', 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal_cat.ecsv', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal_cat.ecsv', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal_cat.ecsv', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal_cat.ecsv', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal_cat.ecsv', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal_cat.ecsv', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal_cat.ecsv']
# Loop through each image and overplot the sources found in the individual catalogs
index=0
for cal_image in imagelist:
indimage = ImageModel(cal_image)
ind_data = indimage.data
indcat = cataloglist[index]
catdata = table.Table.read(indcat, format='ascii', comment='#')
print(cal_image)
print(indcat)
print(len(catdata['xcentroid']), 'sources found')
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(ind_data, cmap='Greys', origin='lower', vmin=0,vmax=50)#, norm=norm)
plt.scatter(catdata['xcentroid'], catdata['ycentroid'],lw=1, s=20,color='red')
plt.show()
index = index+1
print()
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal_cat.ecsv 48 sources found
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal_cat.ecsv 48 sources found
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal_cat.ecsv 49 sources found
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal_cat.ecsv 48 sources found
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal_cat.ecsv 42 sources found
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal_cat.ecsv 42 sources found
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal_cat.ecsv 43 sources found
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal_cat.ecsv 42 sources found
# find stars and get RA, Dec from *_i2d.fits files
#datadir = '/ifs/jwst/wit/miri/pipelinetests/cracraft/build7_8/'
#filelist = 'starfield_50star4ptdither_i2dfiles.txt'
filelist = glob.glob('*exp*i2d.fits')
print(filelist)
print()
# Run DAOStarFinder to find sources in image
allRAdiff_i2d = []
allDecdiff_i2d = []
for i2dimage in filelist:
image = ImageModel(i2dimage)
# pull out data portion of input file
data = image.data
# print stats on input image
print(i2dimage)
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
#sources.pprint_all()
#print(sources['xcentroid','ycentroid','peak'])
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
# using wcs info from images, put coordinates into RA, Dec
ra, dec = image.meta.wcs(sources['xcentroid'], sources['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
print()
# read in text file with RA and Dec input coordinates
RA_in, Dec_in = np.loadtxt( coords, dtype=str, unpack=True)
# put RA and Dec into floats
RA_sim = RA_in.astype(float)
Dec_sim = Dec_in.astype(float)
# Put ra, dec coords into a table
cat1_sim = Table([RA_sim, Dec_sim], names=('ra', 'dec'))
cat2_calc = Table([ra, dec], names=('ra', 'dec'))
# Get coordinates with SkyCoord for each catalog
coord_cat1_sim = SkyCoord(ra=cat1_sim['ra'], dec=cat1_sim['dec'], unit="deg")
coord_cat2_calc = SkyCoord(ra=cat2_calc['ra'], dec=cat2_calc['dec'], unit="deg")
ind_cat2_cat1, dist_2d, _ = match_coordinates_sky(coord_cat1_sim, coord_cat2_calc)
# Find where the catalogs match
cat1_matched = cat1_sim[dist_2d.arcsec<0.05]
cat2_matched = cat2_calc[ind_cat2_cat1[dist_2d.arcsec<0.05]]
#print(cat1_matched)
# Get differences in RA, Dec
ra_diff = cat2_matched['ra'] - cat1_matched['ra']
dec_diff = cat2_matched['dec'] - cat1_matched['dec']
#print(ra_diff)
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
# Compare input RA, Dec to found RA, Dec
print('RA_Diff (mas) Dec_diff (mas) pass/fail')
# Find if the differences are within the allowed 30 mas range
for i in np.arange(0,len(ra_diff)):
#if ra_diff[i] < 30 and dec_diff[i] < 30:
allRAdiff_i2d.append(ra_diff[i])
allDecdiff_i2d.append(dec_diff[i])
if abs(ra_diff[i]) < 30 and abs(dec_diff[i]) < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {}'.format(ra_diff[i], dec_diff[i], test))
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in milliarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(ra_diff,dec_diff)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
meanRAdiff_i2d, medianRAdiff_i2d, stdRAdiff_i2d = sigma_clipped_stats(allRAdiff_i2d, sigma=5.0, maxiters=5) # default sigma=3
meanDecdiff_i2d, medianDecdiff_i2d, stdDecdiff_i2d = sigma_clipped_stats(allDecdiff_i2d, sigma=5.0, maxiters=5) # default sigma=3
print('RA difference mean, median and std (units in mas)',meanRAdiff_i2d, medianRAdiff_i2d, stdRAdiff_i2d)
print('Dec difference mean, median and std (units in mas)',meanDecdiff_i2d, medianDecdiff_i2d, stdDecdiff_i2d)
['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_i2d.fits', 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_i2d.fits', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_i2d.fits', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_i2d.fits', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_i2d.fits', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_i2d.fits', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_i2d.fits', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_i2d.fits']
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_i2d.fits
Image mean, median and std 10.091457 10.796132 50.790142
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
602.8518714876282 3.6008978843515886 0.0008819522509096922 -0.014601674495986792
679.9457317632593 6.236558003637516 359.99852497047624 -0.014313390551491466
880.853223043022 31.521037340728547 359.9924322065792 -0.01299739716370143
948.4065135526386 36.258941437575956 359.9903734425788 -0.012670322034059928
438.9310229591861 62.92831429814884 0.006068218065146617 -0.01322352166298186
703.1419473271875 72.42091300254481 359.9979917650918 -0.012221433322998857
368.2986889377194 83.95583039683632 0.008290736148855343 -0.0127687888357208
423.7567123385246 97.53325044963603 0.00662665940159626 -0.01220319978079373
481.0012685284885 111.01925183750897 0.004907552816945986 -0.011635606446365368
807.6623104005577 133.339536336186 359.99495059383315 -0.010072103546921691
545.0514462292662 142.33552782431786 0.003027734382899278 -0.010502935669082768
851.5471885589122 161.12216284968608 359.9936796329028 -0.009102057069460795
938.3921533217925 161.70305530252818 359.99101810529226 -0.008850541806403114
374.29679225667417 175.52940856721747 0.008353232007749843 -0.009944554570046095
385.9443434350439 182.0722024217341 0.00801366801845074 -0.009712576673957895
459.7694378450034 192.94549926916542 0.005779090262403912 -0.00918048293987627
701.4316633304118 203.09162047292259 359.9983958492023 -0.008219033581119105
466.048133797134 207.76932979045247 0.005626446101925934 -0.008709015737518014
843.5933952379013 221.68955174697263 359.9940865235531 -0.007266168960473975
712.2932810804184 236.40519882150204 359.998152426688 -0.007168247613617467
636.0887904777039 285.2551235699364 0.0006206851631206656 -0.0058753386705731325
691.8434180989099 308.9235180832467 359.99897466817737 -0.004999512817780656
529.9304179879961 349.0684964100819 0.0040477430769232095 -0.004204183994593559
428.0324899071389 417.8483626746754 0.0073575199287225215 -0.0023692673650895116
660.7113343561673 442.1668324209248 0.00028789137389488616 -0.0009973991083429402
700.1205984780726 452.33816827055716 359.9991067821363 -0.0005794448435101081
393.40188989407386 454.6584841058478 0.00851852037413541 -0.0013336810843432348
665.7091448846687 466.713784831922 0.00020069060614263246 -0.00023122036881960886
851.70744013756 551.5400306365846 359.9947253439352 0.0028704932564278204
885.4143808199052 560.947563573847 359.9937170404056 0.0032496804662072907
965.9467339553598 576.4789713019941 359.991289320535 0.003942664033882769
764.8149428240009 585.001979304627 359.9974799394141 0.003662770015994278
810.1568577781661 619.0632962899167 359.9961811947233 0.004829272725352164
454.3086007985628 695.7027308206892 0.007299479717368434 0.006221814867018482
659.348240528559 726.4936732517998 0.0010948218090689674 0.007717782872014787
949.9874692493071 728.529947445277 359.9921878828562 0.008562342916483378
756.885629762189 736.4821503331034 359.9981307281752 0.008286554122763816
473.0071307462635 787.3115183606994 0.006972613190501871 0.009081306107809885
814.663849994407 844.2732818201317 359.99664903454885 0.01174743949963423
769.8467374334766 850.4774495872462 359.99804004176025 0.011817085552412758
815.5099882288393 859.4786287533566 359.99666400582106 0.012215986688460224
805.4565340579586 904.28748910568 359.99709287570994 0.013562991101084769
972.6310386870424 903.7997964464242 359.99196517634937 0.013997906983951668
793.1959853997681 914.9490830461616 359.997497534672 0.013856934186230045
752.0220097010728 916.7389371407249 359.9987649464747 0.013801019599779342
890.7432461182404 932.8763880339586 359.99455450197524 0.014669175134271623
624.1369628141147 973.2819255635808 0.002838685579100677 0.015190761714555509
454.47513086035895 986.9387607864181 0.008078097245677082 0.015152982356743557
RA_Diff (mas) Dec_diff (mas) pass/fail
-3.792691 -7.129441 pass
-5.275181 3.363070 pass
3.208946 -5.036790 pass
5.973846 10.080789 pass
7.093715 -8.605985 pass
8.736077 13.508591 pass
1.871743 2.637486 pass
-0.218109 -18.827942 pass
-1.726653 -16.851904 pass
-4.241487 -11.581661 pass
0.124376 12.382199 pass
2.207486 8.301988 pass
5.484791 -4.208258 pass
1.990141 -2.183207 pass
7.550084 -0.063516 pass
5.878450 3.394550 pass
-1.131915 13.542172 pass
0.150337 -3.292011 pass
0.785035 1.722013 pass
-0.784309 -1.601437 pass
-1.194561 -9.046144 pass
3.152556 14.367964 pass
-2.446074 -12.009478 pass
5.737799 -0.372769 pass
6.354330 16.440037 pass
-1.873017 -11.466479 pass
-0.421718 -13.165501 pass
2.675077 -4.262381 pass
0.324945 1.861416 pass
0.634858 10.465142 pass
-2.006716 13.240677 pass
1.807111 11.430483 pass
0.701004 -9.818189 pass
-0.978569 1.994842 pass
-0.949864 15.160191 pass
2.404866 5.123974 pass
-3.454540 2.449678 pass
2.486182 2.806672 pass
1.238167 -1.824277 pass
0.743685 -1.429789 pass
1.605967 14.343345 pass
0.835228 -1.996452 pass
-7.179044 10.752078 pass
2.643778 18.231591 pass
0.379052 -9.150503 pass
3.057128 -3.720892 pass
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_i2d.fits
Image mean, median and std 10.090668 10.796824 50.761265
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
602.8537062878535 3.60020944407146 0.0008818941343590366 -0.014601690669428518
679.9476892374303 6.236223902693174 359.99852490955146 -0.01431339552904258
880.8556583364457 31.510121658249375 359.9924321025269 -0.012997725338385075
948.4214442598872 36.256837806225654 359.9903729790695 -0.012670346362708664
438.93064173009645 62.927015426928506 0.006068226260194663 -0.013223562518609849
703.129063444857 72.42446356978068 359.99799216972923 -0.012221359116151336
368.2984762727767 83.95853400142276 0.008290749945676966 -0.012768706502291465
423.7599843627015 97.54024916444838 0.006626577899079173 -0.012202976360884965
481.0003231497586 111.01762997835094 0.0049075774424094405 -0.011635658724525716
807.6613823884142 133.3366400120985 359.9949506144965 -0.010072194859660783
545.041579152608 142.33235697971617 0.003028028422847506 -0.010503059455252046
851.541603578204 161.12361916555693 359.9936798080846 -0.009102027441039894
938.3900195467343 161.70354687957584 359.99101817204706 -0.008850532474296268
374.2955624838323 175.52859973205184 0.008353267541995803 -0.009944582682234703
385.95115369234674 182.07032069049305 0.008013454118898831 -0.009712616050447622
459.7695638409601 192.94761652093268 0.005779092096334935 -0.009180417675536366
701.4277587364304 203.09188293568712 359.9983959696426 -0.008219036040082155
466.05113727232 207.77112014276855 0.005626358818589606 -0.008708952754143259
843.5910924556867 221.6882748310524 359.9940865907314 -0.007266214313814531
712.2952775460063 236.40643176403682 359.99815236878453 -0.007168204433038085
636.0779181623979 285.244780661791 0.0006209907283755331 -0.005875685092372385
691.8424165719333 308.92221006762105 359.99897469536916 -0.0049995556230727845
529.9283572407187 349.0701420401064 0.004047810697937713 -0.004204139077070705
428.0302441611541 417.84671330185165 0.0073575843557540585 -0.0023693239862757
660.7137656859323 442.16885650712123 0.00028782226431363367 -0.0009973304971966806
700.1203820681674 452.3365258913462 359.9991067843528 -0.0005794957892456935
393.4031425884345 454.63642667056814 0.008518422603240598 -0.00133435410204385
665.708329281509 466.71516660571814 0.00020071933490914184 -0.0002311801916947844
851.7115565492409 551.5373370822631 359.9947252104575 0.002870421736270071
885.4088360515636 560.9555205937977 359.9937172318479 0.0032499095461942036
965.9406127560494 576.4799409994471 359.9912895108503 0.003942677297230543
764.8133580771308 585.0047077648449 359.99747999535253 0.003662849419320538
810.1556114737737 619.0646642069706 359.9961812366222 0.0048293113185291685
454.311596464154 695.7031109594595 0.007299388878579975 0.006221834585328293
659.34731344196 726.4947403376357 0.0010948531096269724 0.00771781309927168
949.9880556331752 728.5288057132607 359.99218786180234 0.008562309483383608
756.8875706598644 736.4819793499561 359.9981306681977 0.008286554102593295
473.00455558397056 787.2935239429638 0.006972643734085827 0.00908074738121212
814.6631315004347 844.2733140720906 359.9966490566682 0.011747438555153977
769.8445894539997 850.4757111876372 359.9980401029497 0.011817026464327682
815.3991262074476 859.4649645420789 359.9966673686215 0.012215269344382917
805.4542374770984 904.2891287870468 359.9970929505468 0.013563035201545453
972.6207481831105 903.7954763009758 359.99196548028084 0.013997746815178557
793.1913482617852 914.9556380174446 359.99749769450887 0.013857122715016826
752.0224422363402 916.741852343748 359.9987649410559 0.01380111015811566
890.7429807723692 932.8739334488101 359.99455450350666 0.01466909915065146
624.1379952679852 973.281029860747 0.0028386515086586688 0.015190737026298556
454.4743231850817 986.9386162747143 0.00807812162406304 0.015152975751835288
RA_Diff (mas) Dec_diff (mas) pass/fail
-3.812199 -6.803431 pass
-4.699768 4.041774 pass
2.960152 -4.789790 pass
5.680437 10.885101 pass
6.874385 -8.623905 pass
8.527624 13.664041 pass
2.103681 2.433649 pass
-0.016731 -18.542090 pass
-2.078628 -19.274767 pass
-4.128805 -11.472843 pass
0.204006 12.378799 pass
2.317443 6.290572 pass
5.726633 -4.371530 pass
2.078793 -2.371408 pass
7.637847 -0.087293 pass
6.509105 3.501212 pass
-1.254569 13.453295 pass
0.370619 -3.504728 pass
0.814537 1.574933 pass
-0.776330 -1.784841 pass
-1.096671 -9.200243 pass
3.421968 14.526726 pass
-1.760939 -11.961730 pass
5.812187 -0.701495 pass
7.811025 16.707182 pass
-2.200037 -11.395493 pass
-0.497512 -13.285860 pass
2.918513 -4.100677 pass
0.331547 2.096368 pass
1.729011 9.888535 pass
-3.675350 13.153094 pass
1.812624 11.156942 pass
0.851840 -9.679253 pass
-1.194488 1.994769 pass
-0.900196 15.456592 pass
1.634828 4.982218 pass
-2.765348 3.274366 pass
2.589606 2.951310 pass
0.757647 -2.081749 pass
0.369097 -2.611218 pass
1.291747 14.570085 pass
0.963151 -2.097656 pass
4.927037 8.169640 pass
3.702322 17.785961 pass
0.619369 -9.116907 pass
3.490713 -3.729744 pass
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_i2d.fits
Image mean, median and std 10.1105995 10.798032 50.863968
xcentroid ycentroid RA Dec
------------------ ------------------ --------------------- -----------------------
627.2982384405495 43.78548079592043 0.0008795936228094739 -0.014625425802744422
704.4131464120393 47.21203299058368 359.9985240947273 -0.014312832594876732
905.2918224754756 72.51690488624786 359.9924322693176 -0.012996291386001677
972.8043720450302 77.10496974855552 359.99037435141423 -0.012673920686433434
463.4171721524288 103.88844476432784 0.00606672656533526 -0.013223383837893631
727.542733158319 113.36243195627799 359.9979928411359 -0.01222209590327961
392.70795229902416 124.90635161687395 0.008291576498491321 -0.012769152579607175
448.2236144031241 138.44672171239546 0.006625632554263813 -0.012204544540034997
505.4688310529834 152.12524171737894 0.004907023780909617 -0.01163104585756892
832.1247474101697 174.4181444449759 359.99495014826607 -0.010068396376760495
569.4547305553972 183.25604571156236 0.003028677313487358 -0.010504235518099947
876.0025125594971 202.00405842432235 359.9936788761014 -0.009104401199929403
962.8284967092442 202.8442452061705 359.9910186283024 -0.008844985777799762
398.72626785973284 216.48203730645614 0.008353458219652138 -0.0099447992679698
410.39766344877495 222.96544800418502 0.008013003240521201 -0.009714578180979835
484.2254923872583 233.94812596140267 0.005778635967814777 -0.009179122920694234
725.8369560017725 244.24220220176926 359.9983973496505 -0.008213273120636867
490.5213234004228 248.59461371401315 0.005624989127741153 -0.00871304779936113
868.0527419915325 262.8372183277292 359.9940863585994 -0.007260352420900709
736.7806898633113 277.2059994472443 359.9981504677873 -0.007172992168307352
375.6251279596393 300.6554905643781 0.009288365110773307 -0.007425795767774162
660.529063627567 326.2353839460086 0.000620654606185564 -0.005874706953688964
716.2595406833291 350.0461332255877 359.9989757612772 -0.00499458079344425
554.4191277542327 389.92718676180465 0.004045900073410244 -0.004207149861843326
452.51848207669684 458.65291248609986 0.007355614570945863 -0.0023739007560206276
685.193034653582 483.18945546200507 0.0002867044670614153 -0.0009953568542784485
724.5175053147741 493.1721070512582 359.9991076876599 -0.0005834167522704093
417.8027094266406 495.71311583637356 0.008519899803830196 -0.0013308749419514963
690.1742502344124 507.57646579474533 0.0001995821746826924 -0.00023412737812588628
876.1680840839284 592.4423459596898 359.9947244789988 0.002868789615189795
909.8327539617042 601.8144494981432 359.9937173763644 0.003246776632319398
990.3782532114341 617.5377382404059 359.9912897697459 0.003945679580371887
789.2560163571902 626.1172628489509 359.9974802476949 0.003667544354647982
834.567808967328 660.1695257180426 359.996182402348 0.004833688353551507
478.72199467430477 736.7756931351678 0.007300522876501609 0.006225216941175822
683.7944036709797 767.497040643004 0.001094672841302974 0.007719138991723606
974.4842534186997 769.621068840243 359.99218641781107 0.008566526204019535
781.372400866825 777.3953241701876 359.99812909127303 0.008285253735712924
497.48017360537693 828.1972591015449 0.006971323400677231 0.009079127553964695
839.0737838258234 885.1525861651903 359.99664966273076 0.011744893701406611
794.3337927680589 891.5256446264889 359.99803875949885 0.01181992630621926
839.8673582260056 900.2965845894302 359.9966660807779 0.012211418189398216
829.8963256864793 945.19210825062 359.9970926564312 0.013561301906068975
997.070350472072 944.7092814842475 359.99196498493103 0.013996365690261832
817.6076483767828 955.8326609718102 359.99749812133007 0.013854524067137889
776.4964730538783 957.8906711986632 359.99876432897116 0.013807001458935582
915.1976907644887 973.8310739432361 359.99455396812243 0.014669060640882263
648.5058026628144 1014.1628282924328 0.002840578165361207 0.015188154320912275
RA_Diff (mas) Dec_diff (mas) pass/fail
-6.015704 14.405252 pass
-3.163212 -5.313358 pass
-1.063919 2.315325 pass
2.277195 5.239656 pass
3.941018 -6.597342 pass
1.684034 -3.571806 pass
-4.987545 -14.042722 pass
0.891702 -1.640323 pass
3.239294 -6.749791 pass
-4.777771 -6.699630 pass
2.385831 3.217325 pass
-2.435758 0.459194 pass
4.890958 16.731285 pass
0.085611 14.234913 pass
3.153965 -5.044320 pass
5.681395 4.155555 pass
-4.465804 6.934702 pass
-4.584365 2.218184 pass
2.475576 -15.900308 pass
2.740598 8.709144 pass
1.314399 -10.064764 pass
2.363152 8.286862 pass
-0.828915 -1.153511 pass
4.133758 12.973044 pass
10.228089 14.054748 pass
1.882355 0.780988 pass
-5.695880 1.894334 pass
-3.959736 -14.939503 pass
-1.310516 6.757486 pass
-0.054248 4.916485 pass
1.265091 0.285529 pass
-0.114759 11.018307 pass
5.048453 6.078073 pass
-6.871417 -2.686551 pass
2.075395 13.850713 pass
0.011666 -2.081452 pass
-2.245088 -8.004124 pass
-1.504171 -7.658561 pass
-1.875604 -7.957385 pass
0.969543 2.551010 pass
5.737042 2.067110 pass
-3.639140 -0.172078 pass
1.649591 -2.877365 pass
0.290800 -5.694518 pass
6.038329 13.552135 pass
2.261889 10.851200 pass
8.458742 17.016766 pass
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_i2d.fits
Image mean, median and std 10.112085 10.798991 50.85573
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
627.2942925118597 43.7906461694201 0.0008797285244249543 -0.014625278025767564
704.4108923972478 47.21386754193602 359.99852416878326 -0.014312782404175817
905.2918743719139 72.51075470558935 359.9924322511759 -0.012996479840935231
972.7803797552901 77.11030666686527 359.9903751014968 -0.012673821594401564
463.40697685117505 103.89546314278559 0.006067058089735734 -0.013223196055963561
727.5382030860469 113.36396426016982 359.9979929841735 -0.012222061105928547
392.7077119108454 124.90702249333656 0.008291585675311332 -0.012769132654134726
448.2226128507119 138.4447174769215 0.006625657873300073 -0.012204608694868927
505.46884341490323 152.12545078680242 0.004907023964445231 -0.01163103941319976
832.1265416055678 174.41498371858953 359.9949500847417 -0.010068488471838851
569.4553557520503 183.25386958085585 0.0030286522858761814 -0.010504300566474957
876.0024211432682 202.00466097408227 359.99367888052615 -0.009104382968826001
962.8215525981416 202.84191424934733 359.9910188349701 -0.008845075943118234
398.7311475624541 216.46976886515117 0.008353275569410127 -0.009945162346892881
410.39841022895286 222.96432067417746 0.008012977306917928 -0.009714610740826109
484.2323127571306 233.94618135827506 0.00577842158896935 -0.009179164197914836
725.8418248900807 244.23476747665703 359.99839718033945 -0.00821348800333567
490.5214755020804 248.5975350429006 0.005624992324937386 -0.00871295780783329
868.0534304142589 262.8373546552 359.9940863378559 -0.007260346387867863
736.7765799331747 277.2042662330378 359.99815058915374 -0.007173056377060154
375.63380978956434 300.6602372789278 0.009288111656997387 -0.007425626847293503
660.5294770924538 326.2369903401406 0.0006206462501841165 -0.005874656581149793
716.2586310906288 350.04474834548625 359.998975785443 -0.0049946257083736114
554.4200111249362 389.9269795630239 0.004045872427371218 -0.004207153838394348
452.51044151175495 458.65213793224984 0.007355859049597863 -0.0023739461449965625
685.175794269844 483.17744817268914 0.0002872008295237962 -0.000995771450780398
724.5151615474259 493.1724916122017 359.9991077605661 -0.0005834112668952889
417.80170272307987 495.71017566606423 0.00851992276219433 -0.0013309678110038456
690.1733135155167 507.5773163895351 0.00019961318802623557 -0.00023410381546944888
876.1671821378952 592.440735635016 359.99472450232344 0.002868737807612681
909.8314928574409 601.813565121421 359.9937174126561 0.0032467461193392893
990.378728090687 617.5352612908848 359.9912897485182 0.003945604902916047
789.2556407848891 626.1163109287157 359.9974802566502 0.003667514153447479
834.5406140446347 660.1778898039595 359.99618325878515 0.004833871655006329
478.722951717563 736.7732879278951 0.0073004870564041206 0.006225145761215011
683.7952733517797 767.4968166074698 0.001094645569752819 0.007719134462037861
974.4940242337636 769.6435115396165 359.9921861785841 0.008567240700314163
781.3753921765937 777.3965918794567 359.9981290029563 0.008285300659564124
497.4789858286406 828.1978074186687 0.006971361299249594 0.009079141171690014
839.076125684384 885.1506349284701 359.9966495856671 0.01174484016897091
794.3336753306356 891.5119328142013 359.9980387262012 0.011819505519050658
839.8649816565298 900.2999408772401 359.99666616268695 0.01221151471417287
829.8959332842933 945.1920027449312 359.99709266818024 0.013561297614786295
997.0679362740798 944.7081994902067 359.9919650560505 0.013996326014370482
817.6104595540093 955.8339538949311 359.99749803860493 0.013854571279435995
776.4973200387963 957.89562697576 359.99876431633464 0.013807155706512217
915.1909934481031 973.8379209726538 359.99455419192043 0.014669252581609652
648.6053983370131 1014.1574905876851 0.0028375097114721874 0.015188258655449392
RA_Diff (mas) Dec_diff (mas) pass/fail
-6.061195 14.960543 pass
-3.461022 -5.143394 pass
0.722986 0.822777 pass
2.368344 5.008698 pass
4.207620 -6.416655 pass
2.120953 -3.802957 pass
-4.107421 -14.206122 pass
0.923941 -1.749048 pass
3.321944 -7.084120 pass
-4.875949 -6.715937 pass
2.108402 3.024608 pass
-2.299323 0.508218 pass
4.816281 16.753004 pass
0.086272 14.258112 pass
3.169894 -4.978688 pass
-5.365039 4.531160 pass
-4.585676 5.419869 pass
-3.390877 2.894199 pass
2.738038 -15.880561 pass
2.827595 8.547450 pass
0.401965 -9.456650 pass
2.405449 8.271413 pass
-0.905334 -1.422350 pass
3.905070 12.641501 pass
10.743025 14.180019 pass
1.753403 0.524740 pass
-6.557097 4.466521 pass
-4.059261 -14.953818 pass
-2.082280 6.608888 pass
0.201782 4.773652 pass
3.965389 0.642260 pass
0.690914 11.709294 pass
8.131627 6.737958 pass
-7.189357 -2.517626 pass
2.108431 13.922445 pass
-0.081695 -2.198667 pass
-2.114438 -8.113970 pass
-1.392523 -7.573736 pass
-1.791636 -8.143893 pass
0.904233 1.872573 pass
6.222688 2.599107 pass
-3.627630 0.151892 pass
0.992050 -4.184449 pass
0.585673 -5.347029 pass
5.948229 13.317961 pass
3.005892 10.526605 pass
7.849222 16.243188 pass
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_i2d.fits
Image mean, median and std 9.822638 10.788436 47.82297
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
641.7227003865544 122.40951264293068 0.0008799934005888493 -0.014626386155063726
718.815885928043 125.93989351615451 359.99852544000805 -0.014310667500264931
919.7136275426241 151.15984186898842 359.9924328013891 -0.012996679127948331
987.2483489817446 155.70860610390267 359.9903740978196 -0.012675453905560324
477.8170348339017 182.53757476766552 0.0060679482643693815 -0.013223640735401465
742.0029646661105 192.0070683044656 359.99799219948073 -0.012222328120787019
407.1485409215753 203.45298939738487 0.008291273550370442 -0.012772442789168425
462.64987316270816 217.0847831943875 0.006626015039169051 -0.012205069803826277
519.8870125625718 230.6982660454576 0.004907478924143564 -0.011633587204243803
846.5257709876054 253.07150065581033 359.9949513456788 -0.010068520499957566
583.8697169671054 261.8401041356153 0.003029260116290892 -0.010506447086739576
890.4990515019487 280.76705314889995 359.9936774395898 -0.00910090622491698
977.2948622552083 281.3354681946683 359.9910173857028 -0.008849905844982924
413.1727399521116 295.1090840375111 0.008353191233789423 -0.009945607873080155
424.8087161919386 301.65688397444694 0.00801399565565264 -0.009713507608857726
498.61342938237533 312.4770074357876 0.005779899772689189 -0.009183099261093893
740.3566540784005 322.69244324627414 359.998394361362 -0.008219306373873353
504.92040638373174 327.2164217888873 0.0056261612094685295 -0.008714144556969658
882.4696224719073 341.3644385333019 359.99408673034753 -0.007264301791852304
751.2217872802339 355.95809520438365 359.99815070208365 -0.007169980589234828
390.08350018422163 379.32315330679245 0.009287842507335524 -0.007425326838201741
674.9520467059488 404.6881613518217 0.0006206389155228311 -0.00588092267642966
730.7041838566215 428.5261326379373 359.9989751546384 -0.0049999034635436574
568.7821056928636 468.62918354196205 0.004048395100805171 -0.004205884770026591
466.90424780865936 537.2869134994539 0.0073572278387085965 -0.0023746594208333316
699.5901766764614 561.742621050707 0.00028775135671120164 -0.0009985637138904412
739.0114445516255 571.915705365826 359.99910627873766 -0.0005805235308832692
432.2502269142361 574.3720131900784 0.008519686456610876 -0.001330703987620963
704.583321350542 586.2382973995511 0.00020055568670471798 -0.0002339699069172843
890.5719187046769 671.1616253982024 359.99472576771996 0.0028706946092029234
924.2729132654682 680.5315206560736 359.99371754525947 0.003248711657056144
1004.8197419275244 696.2343730645421 359.9912898429014 0.003946991497830826
803.6479731937111 704.6177547219694 359.99748131187533 0.0036627082836322923
849.04499222736 738.6813348720783 359.9961808835405 0.004829428660599996
493.1691188546773 815.4319727268687 0.007300314538134649 0.006225306516463301
698.2394652042935 846.2096723190227 0.0010946794429143936 0.007720951023700461
988.9000992810243 848.3691718674888 359.99218741584593 0.008569347322393601
795.7748504877836 856.1716542599758 359.9981305760053 0.008288904392155445
511.90583642967096 906.7877747662374 0.006971596199594634 0.009077142692607478
853.4742395259057 963.7590748520233 359.99665075159544 0.011743330760947806
808.7492309764655 970.0734285175472 359.99803923093515 0.011816603507921426
854.3177817884617 979.1340434497968 359.996666258934 0.01221707237733555
RA_Diff (mas) Dec_diff (mas) pass/fail
2.704884 -9.229370 pass
3.654141 3.348706 pass
8.784029 1.196999 pass
2.527501 7.269879 pass
0.820219 -16.773915 pass
4.722751 -19.050179 pass
2.471244 -6.134355 pass
-4.754006 -0.176315 pass
6.305744 -2.409261 pass
-1.453681 -6.686307 pass
6.229251 2.513549 pass
1.724127 5.086065 pass
-2.017477 7.537590 pass
-2.768633 -5.027371 pass
-0.186248 1.293353 pass
-2.596544 -5.484711 pass
0.556698 -10.452469 pass
-0.566974 -8.376618 pass
-0.565555 3.569392 pass
8.444444 12.526200 pass
7.918131 13.218765 pass
1.132337 1.103459 pass
-2.102955 12.050361 pass
5.022363 -10.385172 pass
3.239182 -7.557340 pass
0.352151 -5.234060 pass
-0.419254 -9.256822 pass
-1.526381 10.455812 pass
0.984781 2.005959 pass
3.584360 1.772608 pass
-1.637066 -1.038035 pass
2.000472 -7.091665 pass
2.763792 -1.099407 pass
2.885001 1.155139 pass
7.176242 -1.390158 pass
0.580354 -4.120405 pass
0.688442 -5.788343 pass
0.932162 14.660558 pass
8.136419 5.590488 pass
-2.211470 -6.861042 pass
-2.299097 -4.702946 pass
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_i2d.fits
Image mean, median and std 9.822578 10.788697 47.821087
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
641.7228166768773 122.4121359295773 0.000879996893898583 -0.014626305399335291
718.829727317658 125.92633067783606 359.99852497906545 -0.014311046155557164
919.706119823212 151.1629088777233 359.9924330398659 -0.01299660528195927
987.244287435933 155.70744366752422 359.9903742192383 -0.012675500481279833
477.81550142031745 182.53713382614595 0.006067994099737253 -0.013223658383303702
742.0039078022609 192.00855592599353 359.9979921745628 -0.012222279965035457
407.1542751346656 203.439962485529 0.008291062655604997 -0.012772826827015596
462.64891921662485 217.08461954217884 0.006626043851424161 -0.012205077389291176
519.8986729948123 230.6761879513902 0.004907061945557089 -0.011634232847920223
846.5231351727888 253.07315396007164 359.99495143095487 -0.010068476894623427
583.8718931280858 261.84030882303733 0.003029193935384659 -0.010506434953905991
890.4976359347183 280.7678735654924 359.99367748520575 -0.00910088487627827
977.2988551697918 281.331220855103 359.99101725183084 -0.008850025344108938
413.1655396888538 295.1197544705565 0.008353440743468391 -0.009945300041570737
424.80920492325345 301.6558114399569 0.008013977782539332 -0.009713539182804905
498.6127373690878 312.47444605561196 0.005779914100453612 -0.009183179667746302
740.3554013018091 322.69313543725656 359.99839440164095 -0.008219288519173149
504.92260090464134 327.21834682091566 0.005626099095048058 -0.00871407962057786
882.565758996396 341.36979448887786 359.99408379674514 -0.007263878845990648
751.217600536966 355.9543892467843 359.99815082049685 -0.007170105498632704
390.08074779278485 379.31668458715114 0.00928790950160966 -0.007425532607518412
674.9623402622507 404.6862397528395 0.0006203180937055698 -0.00588095390180431
730.7037753814426 428.5260028654385 359.998975166815 -0.004999908542226202
568.773175615084 468.64297600581955 0.004048706056519734 -0.004205485856781699
466.90459390898366 537.2865750098742 0.007357216314697366 -0.002374668869212009
699.5902377297151 561.7443044574502 0.0002877540146139217 -0.0009985119281188408
739.0315778343754 571.9119049491978 359.9991056511258 -0.0005805858910009315
432.25048714747174 574.3733040310184 0.008519681950293317 -0.0013306637038250147
704.5790336446064 586.2387474029681 0.00020068837969070574 -0.00023396764594929228
890.5716393924403 671.161745161816 359.99472577660737 0.002870697530092386
924.2732080992063 680.530295237091 359.99371753292075 0.003248674873139096
1004.8206343562742 696.2338044926988 359.9912898140051 0.003946976464197831
803.6517348853995 704.6304656772519 359.997481230729 0.003663108186431313
849.0458731256971 738.6768290668624 359.99618084440255 0.0048292928611321
493.169555479984 815.4318503256441 0.007300300819681762 0.006225303937996488
698.2423789647694 846.205933816626 0.0010945800323692693 0.0077208442239649995
988.8814280160368 848.3564118316383 359.9921879540605 0.00856890579251247
795.7746482844336 856.17067466041 359.9981305795697 0.008288873808712332
511.90888763582404 906.7861269273278 0.006971498200326669 0.009077100372691896
853.4758384207996 963.7604011256379 359.9966507061345 0.011743375733639582
808.7493571380172 970.0716367246143 359.99803922224464 0.01181654890230473
854.3207213585496 979.137382231564 359.9966661777772 0.012217182671149915
RA_Diff (mas) Dec_diff (mas) pass/fail
2.714453 -9.042941 pass
3.757865 3.321399 pass
7.124636 -0.166160 pass
2.953789 6.820205 pass
0.778733 -16.807929 pass
4.430624 -17.610529 pass
2.455021 -5.989334 pass
-5.111883 -0.560794 pass
6.142084 -2.247359 pass
-1.806479 -6.838658 pass
-4.331717 4.036154 pass
0.223004 2.761747 pass
-1.853259 7.614445 pass
-2.799919 -5.223952 pass
-0.021241 1.229820 pass
-4.855947 -5.709208 pass
0.600534 -10.470752 pass
-0.325794 -9.117387 pass
-0.669582 3.515271 pass
8.751437 12.683179 pass
7.828426 13.392126 pass
1.082951 1.094177 pass
-0.165382 10.460853 pass
6.141803 -8.949084 pass
3.290762 -7.846804 pass
0.789258 -5.401733 pass
-0.560151 -9.745700 pass
-1.513549 10.345711 pass
0.225560 0.623423 pass
3.520017 1.658942 pass
-1.681485 -1.170457 pass
2.478167 -7.083525 pass
2.795786 -1.088892 pass
3.743517 1.420985 pass
7.188818 -1.099438 pass
0.356742 -3.886634 pass
1.586676 -4.680150 pass
0.639998 15.057616 pass
7.898167 5.634166 pass
-2.693409 -7.291239 pass
-2.154093 -4.638669 pass
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_i2d.fits
Image mean, median and std 9.816838 10.789823 48.315887
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
689.9883695183636 101.85249747918233 0.000880494627604281 -0.014628032252966251
767.1146544753882 105.40654002150126 359.9985249899391 -0.01431149893058481
968.0037635883841 130.62789753238783 359.9924326199003 -0.012997490549186596
526.097191640674 162.16814833601413 0.006068510011732581 -0.013219495500390447
790.3062847110347 171.4650547953246 359.99799158654145 -0.012223412872813316
455.47082844885335 182.9287883872101 0.008290126859551163 -0.012772930338668083
510.9543271567537 196.5738119695463 0.0066254508153852235 -0.012205199645730662
568.1112222112675 210.13790423889915 0.004909242477189329 -0.01163544753464979
894.8526337368794 232.5226338425421 359.99494999239516 -0.010069752053566899
632.1621669482332 241.42472399068967 0.0030293212450999097 -0.010503677929044216
938.7261943389261 260.26957125913196 359.99367928249944 -0.009100830416786306
461.4958960665609 274.7041319433102 0.008352338814375668 -0.009942436336358457
473.1341774704027 281.1066900212692 0.008012681699057824 -0.00971478369259735
546.9397272632335 291.9451263595741 0.0057786094447556885 -0.00918381152238294
788.6069735056644 302.12584796032047 359.9983953075267 -0.008221287576297453
553.2318625397711 306.7442162290328 0.005625486590617764 -0.008713066815341645
930.798374082446 320.72606990168055 359.9940850782994 -0.007268272842911106
799.4650475975825 335.39230852282185 359.9981518668933 -0.007171955996963057
438.3992500482662 358.84177100304953 0.009287011529124645 -0.007424518961310727
723.2757527273199 384.52884924792835 0.0006204306831403055 -0.005870217119513983
779.0085099865584 408.14565936616106 359.99897494554887 -0.004996031939738966
617.1115981715793 448.12246189298645 0.0040470745246725046 -0.004205816928210581
515.2049468088627 516.7973961629122 0.007356836507450808 -0.0023741415009823933
747.9057920666293 541.1758803294642 0.0002866948247434502 -0.0010003736956895387
787.2825687794074 551.4095861934005 359.9991067496638 -0.00058059428742688
480.4983088818336 553.8773845531367 0.008520894869128971 -0.001330484399168871
752.9051781116319 565.7669020738741 0.00019956434162669812 -0.00023283933912013476
393.14646081513894 604.9556287785181 0.011336982278913943 7.579150950217771e-07
938.8767812879711 650.5678562848227 359.99472496823176 0.002868026854149161
972.6089701861639 660.0370518646532 359.993716056431 0.0032491728767917193
852.001511400442 684.2236418647179 359.9974795570102 0.0036662939539200165
897.3317440189713 718.1341127778732 359.99618076466226 0.004828139524203978
541.4739222323944 794.8126459850206 0.007299448037981318 0.00622185490567396
746.4796767935385 825.7303824867782 0.0010961704923412407 0.007721619792871717
844.0655578183621 835.5855075026776 359.9981302310685 0.008286432280340662
560.1906435901317 886.4576780243639 0.006972121210297028 0.009082506484602085
901.8179370086663 943.206919828717 359.9966488732041 0.011742043591158076
856.9959080135792 949.6131558610136 359.9980405749135 0.011817872823331013
902.5719253526552 958.438083996861 359.9966667397213 0.01221113446953182
892.6072986926222 1003.2537900669965 359.99709290414853 0.013558587800217169
880.3362391728757 1014.221945739183 359.9974987103826 0.0138619032736091
839.1430053943357 1015.9605768846207 359.99876657485555 0.013804366132275668
RA_Diff (mas) Dec_diff (mas) pass/fail
2.069480 4.918076 pass
-1.042623 21.251785 pass
-1.098631 -15.745304 pass
1.622935 2.881275 pass
7.163781 -1.796150 pass
6.720816 0.158411 pass
-0.588573 -14.909404 pass
-1.594763 -6.141766 pass
6.821529 -5.343837 pass
0.613772 2.231254 pass
-0.456465 -7.043072 pass
0.436357 12.623345 pass
0.281878 -11.782234 pass
8.072918 -1.611125 pass
4.616998 7.810500 pass
2.069689 -0.457836 pass
1.836042 16.216199 pass
-0.901210 -5.739435 pass
-0.196024 3.485017 pass
-3.558495 -5.468261 pass
3.254935 -1.483919 pass
3.572623 8.092607 pass
5.711549 9.313658 pass
-1.987063 -11.322340 pass
0.268289 -10.140942 pass
-1.405999 -10.121481 pass
-0.847216 -13.897713 pass
-2.768153 1.556209 pass
-3.143306 0.250781 pass
-1.145883 -2.821293 pass
-6.996848 0.622356 pass
-1.568370 -3.021621 pass
-0.114366 -10.703325 pass
2.231641 -1.765977 pass
8.980659 -7.316111 pass
-1.848274 -0.240535 pass
-2.380268 5.629189 pass
2.662997 -6.715910 pass
8.356482 15.559455 pass
1.107096 -11.835275 pass
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_i2d.fits
Image mean, median and std 9.816793 10.789996 48.29586
xcentroid ycentroid RA Dec
------------------ ------------------ --------------------- ----------------------
689.9885901264787 101.85033664912017 0.0008804820478196955 -0.014628097920923358
767.1119152629705 105.40818972560808 359.99852507837613 -0.01431145571390041
968.0034768071495 130.62980461337932 359.9924326338264 -0.012997432840511402
526.0994467554968 162.1562969059541 0.006068408966369632 -0.013219852854547274
790.3061510107007 171.4699540522718 359.99799160382537 -0.012223262997461432
455.46995521840296 182.93305913430726 0.008290165129760562 -0.012772801726577855
510.9546501400181 196.57274124482367 0.00662543802979007 -0.012205231610229541
568.112555467316 210.1375163258603 0.004909200549160662 -0.011635455842126224
894.8465072186234 232.50221152757368 359.9949501253071 -0.010070394788134106
632.1613480615864 241.42598439957737 0.0030293497479525846 -0.010503641482411513
938.722763450528 260.27124854158933 359.9936793922209 -0.009100788215739961
461.49072039021746 274.70057292637676 0.008352487948489227 -0.009942559401089126
473.12644264426916 281.10248493802317 0.008012907570628005 -0.009714933455640937
546.9336549868592 291.9448033033366 0.005778794781068123 -0.009183837769520881
788.6015156308075 302.1251242552065 359.9983954729443 -0.00822132445592952
553.2323567289076 306.75283341059054 0.005625494625439253 -0.008712801240569588
930.7872043501388 320.7098537578233 359.99408537717983 -0.007268800167164609
799.4632670368322 335.38912310009295 359.9981519129219 -0.0071720584691262355
438.40056467980605 358.8402796559897 0.009286967202842904 -0.007424561155590005
723.2881244338955 384.5243100573075 0.0006200390910860091 -0.0058703230206689425
778.9998775736685 408.14061165959475 359.9989751966773 -0.0049962099571450305
617.1126675899939 448.1227484001682 0.004047042502077635 -0.00420580526466604
515.206146380071 516.7999052323403 0.00735680647471249 -0.002374061332577991
747.9056851873659 541.1770318272434 0.0002867012008985679 -0.0010003386727572932
787.2833578377877 551.4093588316762 359.99910672485555 -0.0005805991360669924
480.4873247236019 553.8854315466233 0.008521253351759323 -0.0013302671977131332
752.9168071762272 565.752916916247 0.0001991701032590924 -0.0002332368982519863
393.1478807729493 604.9563930506448 0.011336940792753023 7.851725619410268e-07
938.8783206074479 650.5686539749358 359.9947249231753 0.0028680554575743625
972.61043971568 660.0379390561928 359.9937160137555 0.0032492040369676467
851.9989259643369 684.2204432320266 359.99747962768464 0.0036661889107444004
897.3326135314962 718.1309908267625 359.9961807295975 0.004828046129821198
541.4834526785112 794.8170533554535 0.007299167648294172 0.006222015703867949
746.475230677428 825.7364172724862 0.001096323071756837 0.0077217928842625155
844.0652265040663 835.5858312619256 359.9981302420995 0.008286441316813551
560.1924838537312 886.4557176174562 0.006972059503314779 0.009082451321161061
901.8144027111897 943.2015627232523 359.9966489671668 0.011741869805268024
856.995409064311 949.6129942829123 359.9980405897789 0.011817866525873638
902.568565638237 958.4353181162654 359.99666683530353 0.012211040613056967
892.6076477739966 1003.2585252694837 359.99709290618654 0.013558733944033475
880.3377436169004 1014.2336597603291 359.99749869577175 0.013862266531194559
839.1473408301226 1015.9632623598229 359.9987664491366 0.013804460148814408
RA_Diff (mas) Dec_diff (mas) pass/fail
1.616892 5.256536 pass
-1.095222 22.559512 pass
-1.075677 -15.619222 pass
1.576907 2.766203 pass
7.482154 -1.640570 pass
6.886519 -0.210489 pass
-0.696691 -14.620797 pass
-1.340335 -6.519921 pass
8.112066 -4.561912 pass
1.163058 2.854383 pass
-0.118200 -7.668701 pass
0.214212 12.424756 pass
1.357847 -13.680602 pass
7.921977 -1.641032 pass
5.011995 7.962423 pass
2.123204 -0.480507 pass
1.472279 14.929724 pass
-0.990520 -5.756890 pass
0.708038 2.844154 pass
-3.718070 -5.620160 pass
3.262272 -0.957801 pass
4.051106 5.778763 pass
5.773771 9.853209 pass
-2.996466 -10.743466 pass
0.153007 -10.098953 pass
-0.738788 -10.215970 pass
-0.973449 -14.233933 pass
-2.728442 1.588741 pass
-3.005533 0.713784 pass
-0.332746 -3.360440 pass
-7.150480 0.734533 pass
-2.987628 -4.452834 pass
-0.276569 -10.600353 pass
2.281775 -1.558226 pass
8.935372 -7.552515 pass
-1.819348 0.715534 pass
-1.843385 5.186156 pass
3.007093 -7.053793 pass
8.459093 15.690663 pass
1.702599 -11.968041 pass
RA difference mean, median and std (units in mas) 1.1304946902568231 0.7871462078333502 3.6212790667708883 Dec difference mean, median and std (units in mas) 0.09565537802571689 -0.22551204218387855 8.784219193377282
im = ImageModel('starfield_50star4ptdither_combined_i2d.fits')
pixarea = im.meta.photometry.pixelarea_steradians
print('Pixel area in steradians', pixarea)
# pull out data portion of input file
data = im.data
# print stats on input image
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
Pixel area in steradians 2.84403609523084e-13 Image mean, median and std 1.9935058 0.0 46.597652
# Run DAOStarFinder to find sources in image
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
# using wcs info from images, put coordinates into RA, Dec
ra, dec = im.meta.wcs(sources['xcentroid'], sources['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
print()
# Compare input RA, Dec to found RA, Dec
#print(' RA found Dec found RA_Diff (mas) Dec_diff (mas) pass/fail')
deltara_twon = []
deltadec_twon = []
# Put ra, dec coords into a table
cat1_sim = Table([RA_sim, Dec_sim], names=('ra', 'dec'))
cat2_calc = Table([ra, dec], names=('ra', 'dec'))
# Get coordinates with SkyCoord for each catalog
coord_cat1_sim = SkyCoord(ra=cat1_sim['ra'], dec=cat1_sim['dec'], unit="deg")
coord_cat2_calc = SkyCoord(ra=cat2_calc['ra'], dec=cat2_calc['dec'], unit="deg")
ind_cat2_cat1, dist_2d, _ = match_coordinates_sky(coord_cat1_sim, coord_cat2_calc)
# Find where the catalogs match
cat1_matched = cat1_sim[dist_2d.arcsec<0.05]
cat2_matched = cat2_calc[ind_cat2_cat1[dist_2d.arcsec<0.05]]
#print(cat1_matched)
# Get differences in RA, Dec
ra_diff = cat2_matched['ra'] - cat1_matched['ra']
dec_diff = cat2_matched['dec'] - cat1_matched['dec']
#print(ra_diff)
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
# Compare input RA, Dec to found RA, Dec
print('RA_Diff (mas) Dec_diff (mas) pass/fail')
# Find if the differences are within the allowed 30 mas range
for i in np.arange(0,len(ra_diff)):
#if ra_diff[i] < 30 and dec_diff[i] < 30:
deltara_twon.append(ra_diff[i])
deltadec_twon.append(dec_diff[i])
if abs(ra_diff[i]) < 30 and abs(dec_diff[i]) < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {}'.format(ra_diff[i], dec_diff[i], test))
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in milliarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltara_twon,deltadec_twon)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
meanRAdiff_twon, medianRAdiff_twon, stdRAdiff_twon = sigma_clipped_stats(deltara_twon, sigma=5.0, maxiters=5) # default sigma=3
meanDecdiff_twon, medianDecdiff_twon, stdDecdiff_twon = sigma_clipped_stats(deltadec_twon, sigma=5.0, maxiters=5) # default sigma=3
print('RA difference mean, median and std (units in mas)',meanRAdiff_twon, medianRAdiff_twon, stdRAdiff_twon)
print('Dec difference mean, median and std (units in mas)',meanDecdiff_twon, medianDecdiff_twon, stdDecdiff_twon)
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
684.034980321269 127.53398844539224 0.0008802356343729342 -0.014625718676206137
761.1417182748665 131.00120942423692 359.99852509670836 -0.014311900345246747
962.0440451763197 156.25972282333117 359.9924324212947 -0.012996717054211984
1029.5284666496666 160.74893696179484 359.9903750999277 -0.012677453290043333
520.136842038091 187.64742742099904 0.0060679202903298575 -0.013223401436989319
784.3356555548421 197.08543265702477 359.99799169173775 -0.01222301974462638
449.51876246147486 208.5702340961972 0.008289719506872666 -0.01277184115407602
504.97946131176735 222.20944283867547 0.006625726976872019 -0.012204350141108225
562.1911586543955 235.79122461842772 0.004907885739730672 -0.011633908121500811
888.8695246164107 258.1098281382495 359.99495039096337 -0.010070410098904577
626.2027653048982 266.9547690377773 0.0030288390678200965 -0.010506024614790693
932.7665480735247 285.86100796909705 359.993678972983 -0.009101295235158036
1019.559597055788 286.5416740272755 359.99101930586573 -0.008846860123977486
455.5323929357678 300.2762203047845 0.008352095536783545 -0.009943504785330584
467.1459184088566 306.7596322839831 0.008013415140641333 -0.009713439387741782
540.9630021669675 317.64933234266545 0.005779127156596523 -0.009180864195257911
782.6138200387886 327.83260687923655 359.99839633586834 -0.008218306203599078
547.2483322812644 332.3872549424717 0.005626048378856338 -0.008712013491150382
924.8281577712085 346.52711092904025 359.9940856569567 -0.007262338609823332
793.4822837298776 361.0477635422901 359.9981524385734 -0.007170519895013709
432.43565269571786 384.4834868026977 0.009286958505957758 -0.007423452557350121
717.2310772484961 410.0464706330085 0.0006225299688498484 -0.0058731742691597874
773.0305173286173 433.6758459661457 359.998975033816 -0.004998424336621218
611.1366566740264 473.7624219309009 0.004047364647739499 -0.004204834913985617
509.22595321003905 542.4939417276271 0.007357403160111017 -0.002371435198521885
741.930761471085 566.859753368891 0.00028710582899548224 -0.0009980453334030941
781.329534585705 577.0259012182231 359.9991063043413 -0.0005802783897957395
474.5394982764581 579.5208918523185 0.008520699883553112 -0.0013293501956148884
746.9307062333456 591.3670393081165 0.0001997328745577587 -0.0002330772193331652
387.1987946805468 630.3913823599222 0.011335886472379621 -4.448635102062155e-06
932.9197539129307 676.2487522381771 359.9947248190913 0.002870312397390943
966.5603955961991 685.6064301553913 359.9937184144634 0.0032477923924781452
1047.140106474107 701.2915933982723 359.9912896561641 0.003945618287521409
846.0149568813156 709.7840295680821 359.9974799890521 0.00366480466993044
891.37884174868 743.7807054623237 359.99618039672265 0.004829384277789361
535.5302152962653 820.5604059247728 0.007299070442887839 0.0062262266702881085
740.5198481605556 851.3192337277634 0.0010958596032754292 0.007721075286641962
1031.2202059389833 853.4082028856959 359.9921871880386 0.008567415682945162
838.1002310642838 861.2212182158202 359.9981302148479 0.008287309934959726
554.2140041165763 911.9442378966155 0.006972050588117031 0.009078779977179261
895.8521765491728 968.884200398769 359.99664898211563 0.011744194863775106
851.0617009063284 975.2989950670502 359.99803973929454 0.011820371450367094
896.6167926534408 984.1574554931472 359.9966666359998 0.012214605061762097
1053.8480132946736 1028.491300167526 359.9919644623708 0.013997210511429709
886.6562292350268 1028.9254354790737 359.997092547396 0.013560605829646457
874.3946673247614 1039.700037107245 359.997497541532 0.013858011551395035
833.2149643754947 1041.4770548612044 359.99876509439997 0.013801687934237738
971.9370289418877 1057.5136100498 359.9945543530586 0.014666751706024057
705.340456192364 1097.9692713958318 0.0028383736620480934 0.015189901484314459
535.692461077991 1111.6827213962556 0.008077513323474814 0.015153895471808312
RA_Diff (mas) Dec_diff (mas) pass/fail
-3.260160 -4.723437 pass
-5.250485 7.241585 pass
0.380984 -7.363200 pass
2.617117 5.939492 pass
7.548150 -3.241243 pass
8.778864 5.328378 pass
1.451376 -5.166715 pass
-0.039412 -11.503188 pass
6.119581 -1.260704 pass
-0.505428 0.271032 pass
-0.064384 0.701510 pass
0.182117 -0.792082 pass
2.365044 9.581005 pass
3.188663 3.930763 pass
5.447965 3.223699 pass
3.502739 6.137153 pass
-2.254817 10.445344 pass
-0.938540 8.537221 pass
-0.286955 2.154827 pass
-2.504371 -4.602203 pass
0.121738 -5.127612 pass
-3.749379 -1.629206 pass
1.970626 5.780987 pass
-1.237809 -1.374165 pass
5.007468 5.723644 pass
6.090256 10.728919 pass
-3.346406 4.416013 pass
-2.923061 5.096459 pass
1.312732 -6.605690 pass
0.457764 0.488897 pass
-1.935465 7.957841 pass
3.959740 -12.431844 pass
1.271011 2.706142 pass
-2.171798 -9.416600 pass
-2.826548 4.715766 pass
-4.609775 4.171845 pass
1.494506 2.018204 pass
1.492068 -4.347387 pass
-0.961652 -3.877990 pass
-0.651271 -2.475369 pass
1.516661 1.018605 pass
8.048284 1.012766 pass
0.174164 3.551432 pass
-3.256068 1.782773 pass
2.289599 5.778222 pass
6.620644 7.111387 pass
4.701117 4.103554 pass
4.809126 -1.102333 pass
RA difference mean, median and std (units in mas) 1.0447150115866328 0.4193740656094932 3.454680844669165 Dec difference mean, median and std (units in mas) 1.1378019376743747 1.9004884697408633 5.561993337556168
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data, cmap='Greys', origin='lower', vmin=-5,vmax=10)#, norm=norm)
apertures.plot(color='red', lw=2.5) #, alpha=0.5)
plt.show()
Re-run the pipeline with tweakreg turned off to see if the differences found in the previous step are due to tweakreg alone, or differences in the distortion model that would show up in any run of the calwebb_image3 pipeline.
# Run Calwebb_image3 on the association table with tweakreg off
# set any specific parameters
# tweakreg parameters to allow data to run
fwhm = 3.318 #3.27 # Gaussian kernel FWHM of objects expected, default=2.5
minobj = 5 # minimum number of objects needed to match positions for a good fit, default=15
snr = 10 # signal to noise threshold, default=5
sigma = 3 # clipping limit, in sigma units, used when performing fit, default=3
fit_geom ='rshift' # ftype of affine transformation to be considered when fitting catalogs, default='general'
use2dhist = False # boolean indicating whether to use 2D histogram to find initial offset, default=True
pipe3=Image3Pipeline()
#pipe3.tweakreg.kernel_fwhm = fwhm
#pipe3.tweakreg.snr_threshold = snr
#pipe3.tweakreg.minobj = minobj
#pipe3.tweakreg.sigma = sigma
#pipe3.tweakreg.fitgeometry = fit_geom
#pipe3.tweakreg.use2dhist = use2dhist
pipe3.tweakreg.skip = True # test to see if this affects the final output
pipe3.outlier_detection.skip = True # this is set in later step so mis-alignments aren't 'hidden'
pipe3.source_catalog.save_results = True
pipe3.save_results = True
#pipe3.output_dir = datadir
# run Image3
#im = pipe3.run(rtdata.input)
image = pipe3.run('starfield_50star4ptdither_asnfile.json')
print('Image 3 pipeline finished.')
2021-10-30 15:33:48,667 - stpipe.Image3Pipeline - INFO - Image3Pipeline instance created.
2021-10-30 15:33:48,670 - stpipe.Image3Pipeline.assign_mtwcs - INFO - AssignMTWcsStep instance created.
2021-10-30 15:33:48,673 - stpipe.Image3Pipeline.tweakreg - INFO - TweakRegStep instance created.
2021-10-30 15:33:48,675 - stpipe.Image3Pipeline.skymatch - INFO - SkyMatchStep instance created.
2021-10-30 15:33:48,677 - stpipe.Image3Pipeline.outlier_detection - INFO - OutlierDetectionStep instance created.
2021-10-30 15:33:48,679 - stpipe.Image3Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:33:48,681 - stpipe.Image3Pipeline.source_catalog - INFO - SourceCatalogStep instance created.
2021-10-30 15:33:48,819 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline running with args ('starfield_50star4ptdither_asnfile.json',).
2021-10-30 15:33:48,826 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'steps': {'assign_mtwcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'assign_mtwcs', 'search_output_file': True, 'input_dir': ''}, 'tweakreg': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'catalog_format': 'ecsv', 'kernel_fwhm': 2.5, 'snr_threshold': 10.0, 'brightest': 1000, 'peakmax': None, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 15, 'searchrad': 1.0, 'use2dhist': True, 'separation': 0.5, 'tolerance': 1.0, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'general', 'nclip': 3, 'sigma': 3.0, 'align_to_gaia': False, 'gaia_catalog': 'GAIADR2', 'min_gaia': 5, 'save_gaia_catalog': False}, 'skymatch': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'global+match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '0', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}, 'outlier_detection': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}, 'source_catalog': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 100, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 5, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}}}
2021-10-30 15:33:48,924 - stpipe.Image3Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits' reftypes = ['abvegaoffset', 'apcorr', 'drizpars']
2021-10-30 15:33:48,928 - stpipe.Image3Pipeline - INFO - Prefetch for ABVEGAOFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf'.
2021-10-30 15:33:48,932 - stpipe.Image3Pipeline - INFO - Prefetch for APCORR reference file is '/grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits'.
2021-10-30 15:33:48,934 - stpipe.Image3Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:33:48,936 - stpipe.Image3Pipeline - INFO - Starting calwebb_image3 ...
2021-10-30 15:33:49,841 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg running with args (<ModelContainer>,).
2021-10-30 15:33:49,846 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'catalog_format': 'ecsv', 'kernel_fwhm': 2.5, 'snr_threshold': 10.0, 'brightest': 1000, 'peakmax': None, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 15, 'searchrad': 1.0, 'use2dhist': True, 'separation': 0.5, 'tolerance': 1.0, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'general', 'nclip': 3, 'sigma': 3.0, 'align_to_gaia': False, 'gaia_catalog': 'GAIADR2', 'min_gaia': 5, 'save_gaia_catalog': False}
2021-10-30 15:33:49,847 - stpipe.Image3Pipeline.tweakreg - INFO - Step skipped.
2021-10-30 15:33:49,858 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg done
2021-10-30 15:33:50,077 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch running with args (<ModelContainer>,).
2021-10-30 15:33:50,079 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'global+match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '0', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}
2021-10-30 15:33:50,180 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:33:50,181 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() started on 2021-10-30 15:33:50.180167
2021-10-30 15:33:50,182 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:33:50,182 - stpipe.Image3Pipeline.skymatch - INFO - Sky computation method: 'global+match'
2021-10-30 15:33:50,183 - stpipe.Image3Pipeline.skymatch - INFO - Sky matching direction: DOWN
2021-10-30 15:33:50,183 - stpipe.Image3Pipeline.skymatch - INFO - Sky subtraction from image data: OFF
2021-10-30 15:33:50,184 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:33:50,185 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing differences in sky values in overlapping regions.
2021-10-30 15:33:56,987 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0109372
2021-10-30 15:33:56,988 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.022236
2021-10-30 15:33:56,989 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0132933
2021-10-30 15:33:56,990 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00937814
2021-10-30 15:33:56,990 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0
2021-10-30 15:33:56,991 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00884242
2021-10-30 15:33:56,991 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00383076
2021-10-30 15:33:56,992 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0136089
2021-10-30 15:33:56,993 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:33:56,993 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing "global" sky - smallest sky value across *all* input images.
2021-10-30 15:33:57,160 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:33:57,161 - stpipe.Image3Pipeline.skymatch - INFO - "Global" sky value correction: 10.812714931864468 [not converted]
2021-10-30 15:33:57,162 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:33:57,162 - stpipe.Image3Pipeline.skymatch - INFO - ---- Final (match+global) sky for:
2021-10-30 15:33:57,163 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8237 (old=0.0109372, delta=10.8127)
2021-10-30 15:33:57,163 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.835 (old=0.022236, delta=10.8127)
2021-10-30 15:33:57,164 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.826 (old=0.0132933, delta=10.8127)
2021-10-30 15:33:57,164 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8221 (old=0.00937814, delta=10.8127)
2021-10-30 15:33:57,165 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8127 (old=0, delta=10.8127)
2021-10-30 15:33:57,165 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8216 (old=0.00884242, delta=10.8127)
2021-10-30 15:33:57,166 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8165 (old=0.00383076, delta=10.8127)
2021-10-30 15:33:57,167 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8263 (old=0.0136089, delta=10.8127)
2021-10-30 15:33:57,167 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:33:57,168 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() ended on 2021-10-30 15:33:57.167574
2021-10-30 15:33:57,168 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() TOTAL RUN TIME: 0:00:06.987407
2021-10-30 15:33:57,169 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:33:57,185 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch done
2021-10-30 15:33:57,440 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection running with args (<ModelContainer>,).
2021-10-30 15:33:57,443 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None}
2021-10-30 15:33:57,444 - stpipe.Image3Pipeline.outlier_detection - INFO - Step skipped.
2021-10-30 15:33:57,449 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection done
2021-10-30 15:33:57,690 - stpipe.Image3Pipeline.resample - INFO - Step resample running with args (<ModelContainer>,).
2021-10-30 15:33:57,693 - stpipe.Image3Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:33:57,712 - stpipe.Image3Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:33:57,867 - stpipe.Image3Pipeline.resample - INFO - Blending metadata for starfield_50star4ptdither_combined.fits
2021-10-30 15:33:58,472 - stpipe.Image3Pipeline.resample - INFO - Resampling science data
2021-10-30 15:33:59,206 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:00,519 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:01,775 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:02,908 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:04,081 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:05,257 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:06,424 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:07,600 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:08,134 - stpipe.Image3Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:34:08,772 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:09,916 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:11,055 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:12,192 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:13,331 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:14,473 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:15,624 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:16,764 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:17,296 - stpipe.Image3Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:34:17,954 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:19,120 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:20,333 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:21,542 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:22,753 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:23,963 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:25,119 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:26,271 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:26,796 - stpipe.Image3Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:34:27,432 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:28,601 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:29,754 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:30,900 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:32,056 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:33,229 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:34,380 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:35,494 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:34:36,041 - stpipe.Image3Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:34:36,043 - stpipe.Image3Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021513048 -0.020377659 0.024586201 0.014641639 359.990548179 0.017628679 359.987475025 -0.017390618
2021-10-30 15:34:36,454 - stpipe.Image3Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_combined_i2d.fits
2021-10-30 15:34:36,456 - stpipe.Image3Pipeline.resample - INFO - Step resample done
2021-10-30 15:34:36,656 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog running with args (<ImageModel(1142, 1111) from starfield_50star4ptdither_combined_i2d.fits>,).
2021-10-30 15:34:36,659 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 100, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 5, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}
2021-10-30 15:34:36,676 - stpipe.Image3Pipeline.source_catalog - INFO - Using APCORR reference file /grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits
2021-10-30 15:34:36,686 - stpipe.Image3Pipeline.source_catalog - INFO - Using ABVEGAOFFSET reference file /grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf
2021-10-30 15:34:36,687 - stpipe.Image3Pipeline.source_catalog - INFO - Instrument: MIRI
2021-10-30 15:34:36,688 - stpipe.Image3Pipeline.source_catalog - INFO - Detector: MIRIMAGE
2021-10-30 15:34:36,689 - stpipe.Image3Pipeline.source_catalog - INFO - Filter: F1130W
2021-10-30 15:34:36,691 - stpipe.Image3Pipeline.source_catalog - INFO - Subarray: FULL
2021-10-30 15:34:36,733 - stpipe.Image3Pipeline.source_catalog - INFO - AB to Vega magnitude offset 5.49349
2021-10-30 15:34:37,182 - stpipe.Image3Pipeline.source_catalog - INFO - Detected 663 sources
2021-10-30 15:34:37,872 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote source catalog: starfield_50star4ptdither_combined_cat.ecsv
2021-10-30 15:34:37,965 - stpipe.Image3Pipeline.source_catalog - INFO - Saved model in starfield_50star4ptdither_combined_segm.fits
2021-10-30 15:34:37,967 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote segmentation map: starfield_50star4ptdither_combined_segm.fits
2021-10-30 15:34:37,968 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog done
2021-10-30 15:34:37,970 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline done
Image 3 pipeline finished.
im = ImageModel('starfield_50star4ptdither_combined_i2d.fits')
pixarea = im.meta.photometry.pixelarea_steradians
print('Pixel area in steradians', pixarea)
# pull out data portion of input file
data = im.data
# print stats on input image
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
Pixel area in steradians 2.84403609523084e-13 Image mean, median and std 1.993806 0.0 46.609962
# Run DAOStarFinder to find sources in image
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
#sources.pprint_all()
#print(sources['xcentroid','ycentroid','peak'])
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
# using wcs info from images, put coordinates into RA, Dec
ra, dec = im.meta.wcs(sources['xcentroid'], sources['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
print()
# Compare input RA, Dec to found RA, Dec
#print(' RA found Dec found RA_Diff (mas) Dec_diff (mas) pass/fail')
deltara_twoff = []
deltadec_twoff = []
# Put ra, dec coords into a table
cat1_sim = Table([RA_sim, Dec_sim], names=('ra', 'dec'))
cat2_calc = Table([ra, dec], names=('ra', 'dec'))
# Get coordinates with SkyCoord for each catalog
coord_cat1_sim = SkyCoord(ra=cat1_sim['ra'], dec=cat1_sim['dec'], unit="deg")
coord_cat2_calc = SkyCoord(ra=cat2_calc['ra'], dec=cat2_calc['dec'], unit="deg")
ind_cat2_cat1, dist_2d, _ = match_coordinates_sky(coord_cat1_sim, coord_cat2_calc)
# Find where the catalogs match
cat1_matched = cat1_sim[dist_2d.arcsec<0.05]
cat2_matched = cat2_calc[ind_cat2_cat1[dist_2d.arcsec<0.05]]
#print(cat1_matched)
# Get differences in RA, Dec
ra_diff = cat2_matched['ra'] - cat1_matched['ra']
dec_diff = cat2_matched['dec'] - cat1_matched['dec']
#print(ra_diff)
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
# Compare input RA, Dec to found RA, Dec
print('RA_Diff (mas) Dec_diff (mas) pass/fail')
# Find if the differences are within the allowed 30 mas range
for i in np.arange(0,len(ra_diff)):
#if ra_diff[i] < 30 and dec_diff[i] < 30:
deltara_twoff.append(ra_diff[i])
deltadec_twoff.append(dec_diff[i])
if abs(ra_diff[i]) < 30 and abs(dec_diff[i]) < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {}'.format(ra_diff[i], dec_diff[i], test))
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in milliarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltara_twoff,deltadec_twoff)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
meanRAdiff_twoff, medianRAdiff_twoff, stdRAdiff_twoff = sigma_clipped_stats(deltara_twoff, sigma=5.0, maxiters=5) # default sigma=3
meanDecdiff_twoff, medianDecdiff_twoff, stdDecdiff_twoff = sigma_clipped_stats(deltadec_twoff, sigma=5.0, maxiters=5) # default sigma=3
print('RA difference mean, median and std (units in mas)',meanRAdiff_twoff, medianRAdiff_twoff, stdRAdiff_twoff)
print('Dec difference mean, median and std (units in mas)',meanDecdiff_twoff, medianDecdiff_twoff, stdDecdiff_twoff)
xcentroid ycentroid RA Dec
------------------ ------------------ --------------------- ----------------------
684.0400698585463 127.5400100515247 0.0008802511796999219 -0.014625889206972624
761.1468556564452 131.00067729567522 359.9985250931503 -0.014312271716775992
962.0489284066687 156.26385686491724 359.99243243808695 -0.012996946022075776
1029.5366909532854 160.7591742082718 359.9903750306902 -0.012677486112921606
520.1418020552057 187.65026263826152 0.006067931232727763 -0.013223670026533024
784.3408984326752 197.09169125633446 359.99799170321864 -0.012223182595357774
449.42382202266435 208.5751025120351 0.008292799356770023 -0.01277231623065702
504.98438782660713 222.21189600823215 0.006625737918511884 -0.012204630536236933
562.1960390803579 235.79542972828344 0.004907902809198556 -0.01163413491764065
888.8744071428839 258.1155188936408 359.99495041196633 -0.010070591332216551
626.2076976114643 266.9580109854713 0.00302885195448657 -0.010506280806541127
932.7710294906908 285.8649085953745 359.9936790014686 -0.009101532441979417
1019.5630606216728 286.4483198888769 359.99101910384843 -0.008850082375964538
455.53820672691364 300.27937530115435 0.008352081158829591 -0.0099437612713402
467.1505465713554 306.7627792706496 0.008013437098302486 -0.009713699309934454
540.9672299653107 317.65173801027305 0.005779159396469602 -0.00918114792731586
782.6190303657494 327.83718262915414 359.9983963438188 -0.008218520746295171
547.2530720689647 332.3904134185009 0.005626066944462099 -0.00871227276064748
924.8326568378717 346.5336639618088 359.9940856920389 -0.007262494433407035
793.4876485703863 361.05150337564584 359.9981524395363 -0.007170759655218155
432.44004167652946 384.48253961579985 0.009286976780567373 -0.007423838670560433
717.2355277402163 410.0448801694388 0.0006225446261554606 -0.005873579942847253
773.0344288151059 433.6809269514123 359.9989750829549 -0.004998626881570525
611.1405628963953 473.76659288209237 0.004047411499150297 -0.004205065379163421
509.229209856492 542.4976483198873 0.007357468681066727 -0.002371681651267138
741.9341856401901 566.8634133098296 0.00028716608735866 -0.0009982927658999357
781.3333929649751 577.030782712478 359.9991063545719 -0.0005804871950281582
474.54343375073876 579.5243491904719 0.008520743917585004 -0.0013296024649673323
746.9339947275042 591.3724387163854 0.0001998019743471305 -0.0002332716763717268
387.2014632889717 630.3782467058318 0.011335924702500296 -5.213135840533011e-06
932.9226119407074 676.2531932484748 359.99472489881225 0.0028700873927927175
966.565423275594 685.6114760383125 359.9937184292799 0.0032475917748273366
1047.1430498926218 701.3033332567963 359.99128975290796 0.003945617331054564
846.0177357692779 709.7890030283751 359.9974800726327 0.0036645957798902102
891.3819388023355 743.7845506022204 359.9961804675103 0.004829141644131573
535.5331763235794 820.5644664866659 0.007299145981515652 0.006225990276458766
740.5225734021949 851.3237728262542 0.0010959436600041326 0.007720852932575012
1031.2223111354124 853.4201844958039 359.99218731113695 0.008567419884095342
838.1022318473604 861.2253500123899 359.998130320024 0.008287073141485765
554.2154333875196 911.9456455035378 0.006972165958703899 0.009078458108785383
895.8541288257485 968.8891440870515 359.996649090964 0.011743982836339461
851.0626012101751 975.3006877839088 359.9980398716531 0.011820056901394217
896.6190567571037 984.161766381426 359.99666673358314 0.012214374468722665
1053.8504251392694 1028.5114036641028 359.99196459792205 0.013997464594463039
886.6596500067193 1028.9313740695436 359.99709261389046 0.013560428262541209
874.3991681337557 1039.705683425443 359.99749757412076 0.013857827928181183
833.2172498454953 1041.4882913731665 359.99876520996514 0.013801669772154768
971.9384003488178 1057.5323607347511 359.9945545168743 0.014666961505391745
705.3412958582675 1097.9800800309988 0.0028385324112377647 0.015189866310714586
535.7030861169736 1111.699262334545 0.00807738743109288 0.01515406241132796
RA_Diff (mas) Dec_diff (mas) pass/fail
-2.844125 -4.788820 pass
-5.133165 6.580541 pass
0.597914 -8.253957 pass
2.656507 4.930070 pass
7.535341 -4.578180 pass
8.782331 4.465241 pass
1.687252 -6.053945 pass
0.261478 -12.255192 pass
6.278103 -2.168874 pass
-0.202824 -0.529443 pass
0.327470 -0.061789 pass
0.597451 -1.950808 pass
2.491340 9.020040 pass
3.250113 3.114296 pass
4.994752 3.824681 pass
3.605287 5.283209 pass
-1.683320 10.318719 pass
-0.462049 7.404845 pass
-0.247562 1.187904 pass
-2.323541 -5.353902 pass
0.298638 -5.856774 pass
-3.683590 -3.019214 pass
2.210006 5.141745 pass
-0.889531 -1.377608 pass
5.083079 5.071204 pass
6.131587 10.142657 pass
-3.074467 3.564995 pass
-2.479907 5.111583 pass
1.481397 -7.435365 pass
0.573827 -0.532538 pass
-1.447481 8.872540 pass
3.710485 -12.550007 pass
1.860748 3.461419 pass
-1.916963 -10.290081 pass
-2.447914 3.863309 pass
6.477684 2.461570 pass
1.573554 1.082484 pass
1.545408 -5.069611 pass
-0.712892 -4.578035 pass
-0.364276 -3.285386 pass
1.577113 0.194321 pass
8.104247 0.398855 pass
0.241000 2.618062 pass
-3.307828 0.859423 pass
2.640899 4.948087 pass
6.667036 6.189096 pass
3.973854 -7.496553 pass
4.837748 -1.874687 pass
RA difference mean, median and std (units in mas) 1.4340044581710654 1.03965571612288 3.323691372967138 Dec difference mean, median and std (units in mas) 0.22396098505807513 0.6291390369173033 5.730980813206774
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data, cmap='Greys', origin='lower', vmin=-5,vmax=10)#, norm=norm)
apertures.plot(color='red', lw=2.5) #, alpha=0.5)
plt.show()
# Compare stats across tests:
print('All units are milliarcseconds for statistics')
print('Statistics on differences between RA and Dec in individual calibrated files')
print('RA difference mean, median and std',meanRAdiff_cal, medianRAdiff_cal, stdRAdiff_cal)
print('Dec difference mean, median and std',meanDecdiff_cal, medianDecdiff_cal, stdDecdiff_cal)
print()
print('Statistics on differences between RA and Dec in individual i2d files when run with tweakreg on')
print('RA difference mean, median and std',meanRAdiff_i2d, medianRAdiff_i2d, stdRAdiff_i2d)
print('Dec difference mean, median and std',meanDecdiff_i2d, medianDecdiff_i2d, stdDecdiff_i2d)
print()
print('Statistics on differences between RA and Dec in combined i2d file when run with tweakreg on')
print('RA difference mean, median and std',meanRAdiff_twon, medianRAdiff_twon, stdRAdiff_twon)
print('Dec difference mean, median and std',meanDecdiff_twon, medianDecdiff_twon, stdDecdiff_twon)
print()
print('Statistics on differences between RA and Dec in combined i2d file when run with tweakreg off')
print('RA difference mean, median and std',meanRAdiff_twoff, medianRAdiff_twoff, stdRAdiff_twoff)
print('Dec difference mean, median and std',meanDecdiff_twoff, medianDecdiff_twoff, stdDecdiff_twoff)
All units are milliarcseconds for statistics Statistics on differences between RA and Dec in individual calibrated files RA difference mean, median and std 1.1037660880047775 0.9281835036028911 3.549202125823858 Dec difference mean, median and std -0.06135758681286737 1.0161649008182116 5.550928948928192 Statistics on differences between RA and Dec in individual i2d files when run with tweakreg on RA difference mean, median and std 1.1304946902568231 0.7871462078333502 3.6212790667708883 Dec difference mean, median and std 0.09565537802571689 -0.22551204218387855 8.784219193377282 Statistics on differences between RA and Dec in combined i2d file when run with tweakreg on RA difference mean, median and std 1.0447150115866328 0.4193740656094932 3.454680844669165 Dec difference mean, median and std 1.1378019376743747 1.9004884697408633 5.561993337556168 Statistics on differences between RA and Dec in combined i2d file when run with tweakreg off RA difference mean, median and std 1.4340044581710654 1.03965571612288 3.323691372967138 Dec difference mean, median and std 0.22396098505807513 0.6291390369173033 5.730980813206774
This test uses MIRISim data using only the simulated dithers, and one shifted image. Two exposures each of four different dithers.
First look at the cal images out of calwebb_image2.
# apply shifts to files in input list
# Read in a single rate.fits file, modify header values RA_REF and DEC_REF by adding in a shift of less than one
# arcsecond, which is the default search radius for tweakreg
# 0.72 arcseconds ~ 0.0002 degrees
# 0.5 arcseconds ~ 0.00014 degrees
origfile = 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits'
model = ImageModel(origfile)
# modify header vaules
model.meta.wcsinfo.ra_ref = model.meta.wcsinfo.ra_ref + 0.00014
model.meta.wcsinfo.dec_ref = model.meta.wcsinfo.dec_ref + 0.00014
# Run file through calwebb_image2 to get cal.fits version and then retest steps in Test # 1.
# create an object for the pipeline
pipe2 = Image2Pipeline()
pipe2.save_results = True
#pipe2.output_file = rampfile+'_cal.fits'
#pipe2.output_dir = datadir
pipe2.run(model)
2021-10-30 15:34:39,266 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-30 15:34:39,268 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-30 15:34:39,270 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-30 15:34:39,272 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-30 15:34:39,274 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-30 15:34:39,276 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:34:39,438 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:34:39,443 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-30 15:34:39,451 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2021-10-30 15:34:39,465 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2021-10-30 15:34:39,467 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2021-10-30 15:34:39,468 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2021-10-30 15:34:39,469 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2021-10-30 15:34:39,470 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2021-10-30 15:34:39,472 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2021-10-30 15:34:39,475 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:34:39,476 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2021-10-30 15:34:39,477 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2021-10-30 15:34:39,480 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2021-10-30 15:34:39,482 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2021-10-30 15:34:39,483 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2021-10-30 15:34:39,483 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2021-10-30 15:34:39,484 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2021-10-30 15:34:39,485 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2021-10-30 15:34:39,486 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2021-10-30 15:34:39,486 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2021-10-30 15:34:39,487 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2021-10-30 15:34:39,489 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2021-10-30 15:34:39,489 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2021-10-30 15:34:39,490 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2021-10-30 15:34:39,491 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-30 15:34:39,491 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-30 15:34:39,492 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-30 15:34:39,548 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate
2021-10-30 15:34:39,549 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits> ...
2021-10-30 15:34:39,664 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:34:39,666 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-30 15:34:39,836 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-10-30 15:34:39,895 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:34:39,901 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020189678 -0.017320337 0.022657284 0.013866832 359.991598175 0.016439486 359.988791107 -0.014761383
2021-10-30 15:34:39,902 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020189678 -0.017320337 0.022657284 0.013866832 359.991598175 0.016439486 359.988791107 -0.014761383
2021-10-30 15:34:39,903 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2021-10-30 15:34:39,939 - stpipe.Image2Pipeline.assign_wcs - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:779: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2021-10-30 15:34:39,990 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-30 15:34:40,116 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:34:40,119 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-30 15:34:40,227 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:34:40,228 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:34:40,230 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:34:40,241 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2021-10-30 15:34:40,349 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-30 15:34:40,463 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:34:40,465 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-30 15:34:40,499 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2021-10-30 15:34:40,500 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2021-10-30 15:34:40,569 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2021-10-30 15:34:40,570 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2021-10-30 15:34:40,571 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2021-10-30 15:34:40,572 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2021-10-30 15:34:40,611 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2021-10-30 15:34:40,613 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2021-10-30 15:34:40,614 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2021-10-30 15:34:40,627 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-30 15:34:40,739 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2021-10-30 15:34:40,742 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:34:40,767 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:34:40,876 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2021-10-30 15:34:41,582 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:34:42,107 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:34:42,771 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:34:43,296 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:34:43,917 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:34:44,447 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:34:45,067 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1023, 1023)
2021-10-30 15:34:45,613 - stpipe.Image2Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:34:45,616 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020137794 -0.017516179 0.022888024 0.013823333 359.991517847 0.016576254 359.988767617 -0.014763258
2021-10-30 15:34:45,725 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_i2d.fits
2021-10-30 15:34:45,727 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-30 15:34:45,728 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate
2021-10-30 15:34:45,730 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-30 15:34:45,875 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits
2021-10-30 15:34:45,877 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
[<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits>]
# find stars and get RA, Dec from *_cal.fits files
# Run DAOStarFinder to find sources in image
allRAdiff_cal = []
allDecdiff_cal = []
for calimage in imagelist:
image = ImageModel(calimage)
# pull out data portion of input file
data = image.data
# print stats on input image
print(calimage)
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
# using wcs info from images, put coordinates into RA, Dec
ra, dec = image.meta.wcs(sources['xcentroid'], sources['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
print()
# read in text file with RA and Dec input coordinates
RA_in, Dec_in = np.loadtxt(coords, dtype=str, unpack=True)
# put RA and Dec into floats
RA_sim = RA_in.astype(float)
Dec_sim = Dec_in.astype(float)
# Put ra, dec coords into a table
cat1_sim = Table([RA_sim, Dec_sim], names=('ra', 'dec'))
cat2_calc = Table([ra, dec], names=('ra', 'dec'))
# Get coordinates with SkyCoord for each catalog
coord_cat1_sim = SkyCoord(ra=cat1_sim['ra'], dec=cat1_sim['dec'], unit="deg")
coord_cat2_calc = SkyCoord(ra=cat2_calc['ra'], dec=cat2_calc['dec'], unit="deg")
ind_cat2_cat1, dist_2d, _ = match_coordinates_sky(coord_cat1_sim, coord_cat2_calc)
# Find where the catalogs match
cat1_matched = cat1_sim[dist_2d.arcsec<0.05]
cat2_matched = cat2_calc[ind_cat2_cat1[dist_2d.arcsec<0.05]]
#print(cat1_matched)
# Get differences in RA, Dec
ra_diff = cat2_matched['ra'] - cat1_matched['ra']
dec_diff = cat2_matched['dec'] - cat1_matched['dec']
#print(ra_diff)
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
# Compare input RA, Dec to found RA, Dec
print('RA_Diff (mas) Dec_diff (mas) pass/fail')
# Find if the differences are within the allowed 30 mas range
for i in np.arange(0,len(ra_diff)):
#if ra_diff[i] < 30 and dec_diff[i] < 30:
allRAdiff_cal.append(ra_diff[i])
allDecdiff_cal.append(dec_diff[i])
if abs(ra_diff[i]) < 30 and abs(dec_diff[i]) < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {}'.format(ra_diff[i], dec_diff[i], test))
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in milliarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(ra_diff,dec_diff)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
meanRAdiff_cal, medianRAdiff_cal, stdRAdiff_cal = sigma_clipped_stats(allRAdiff_cal, sigma=5.0, maxiters=5) # default sigma=3
meanDecdiff_cal, medianDecdiff_cal, stdDecdiff_cal = sigma_clipped_stats(allDecdiff_cal, sigma=5.0, maxiters=5) # default sigma=3
print('RA difference mean, median and std (units in mas)',meanRAdiff_cal, medianRAdiff_cal, stdRAdiff_cal)
print('Dec difference mean, median and std (units in mas)',meanDecdiff_cal, medianDecdiff_cal, stdDecdiff_cal)
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits
Image mean, median and std 11.393542 10.826687 55.011623
xcentroid ycentroid RA Dec
------------------ ------------------ --------------------- ----------------------
608.5415674187961 2.5119766176307223 0.0008812919624467749 -0.014594789515541495
685.5194495798157 5.5188105009736175 359.9985262521632 -0.014309517462321978
886.3394041097413 32.119070281158955 359.99243205390275 -0.012997454423196865
953.8640393199 37.04011242844017 359.9903742953238 -0.012674257323148128
444.47609551197064 61.922582668650286 0.006066875156909462 -0.013223542150700983
708.539078792773 73.05874981354657 359.9979903713137 -0.01222441448341229
373.69156711571156 82.73445867221936 0.00829150779169885 -0.012772340592118013
429.1719580852977 96.9350873606011 0.0066252609207797806 -0.01220541183653611
486.33656250883286 111.09479540127342 0.0049071267763785495 -0.011634212317900124
812.818016502769 135.61499300669485 359.9949510782622 -0.010070810306428344
550.2541709849713 143.00728324989907 0.003027257861743836 -0.010506369320026828
856.669674639311 163.941532747077 359.99367943542825 -0.009101781916248714
943.4770993700253 165.11663853495494 359.99102011241314 -0.008847567308604684
379.3675519242359 175.61124295871804 0.008352878219398573 -0.009943295128109814
390.9846006266449 182.23371017799838 0.008013454071705377 -0.009712529245328462
464.78741113955334 193.6264598801728 0.005779073595006636 -0.009180116965875892
706.4675734066059 205.4374537771488 359.99839582116016 -0.008215197294039717
471.0120867553802 208.50201007466694 0.005626274700481911 -0.008710684120420042
848.6281552463014 225.05905956689554 359.99408676890266 -0.007263193491265538
717.2680096211556 238.78542812577177 359.9981519861035 -0.007170315851777638
640.8254738397458 287.3850110723211 0.000623866158697791 -0.005872632451303791
696.647862932052 311.4570263322215 359.9989761969678 -0.004996253375845009
534.5080406150863 350.3689320851547 0.004046584544183354 -0.004204164820881179
432.09694109427744 418.3411466005772 0.007357153703276762 -0.002371455183037188
665.3824794715022 444.0669679431664 0.0002867232340403056 -0.0009972307220539013
704.8442236777602 454.5198152664274 359.999107133171 -0.000579048618063702
397.1594591938331 455.0466542459958 0.008519471619160033 -0.0013305641705300796
670.371981463498 468.5413077513855 0.0001994299693774992 -0.0002316467303177302
857.038262255815 554.7270783588783 359.9947248543858 0.0028686960910657405
890.8576431575337 564.4910139563399 359.99371776586474 0.0032483115672433368
971.7410107427238 581.0301273603288 359.99129032918023 0.00394460501697729
769.8182651492822 587.3991534539016 359.99748044484795 0.003666592325947924
815.4649708309157 621.70236297117 359.9961801265635 0.004829526225418064
457.3069563867852 695.4839439228793 0.007299417401295441 0.006221092374688667
663.7522305772287 727.5606487303378 0.0010956440902465164 0.007718343531580888
956.3618123173031 732.7240339832271 359.99218701382824 0.008563603509703683
762.012822991855 738.3493833972611 359.9981307363725 0.008284707812831934
475.7809197718267 787.1175421157932 0.006972911155176817 0.009078806556077986
820.4534971417371 846.8578899992237 359.9966476213018 0.011744457761829495
775.2535830946825 852.768447668375 359.99803938143555 0.011819236104458666
821.2496942034151 862.1639462053263 359.9966653732796 0.012214125952000665
811.2868482580394 907.0113339507423 359.9970911975458 0.013560409281168691
979.8333015194123 908.5670123070836 359.99196470996947 0.013994547909521428
798.8612490361676 917.691370731965 359.9974981525205 0.013857233119648482
757.3289724429274 919.148267240695 359.99876455354797 0.01380396414649375
897.3875798865843 936.7583695764755 359.99455365921426 0.014667036969114682
628.0267683752969 974.7373812387208 0.0028386713057134997 0.015187773153686161
456.3574329732993 987.6670781265088 0.008076589320650552 0.015153509703638865
RA_Diff (mas) Dec_diff (mas) pass/fail
-5.207227 3.470927 pass
-3.050926 4.439231 pass
-0.996357 -4.430599 pass
0.939315 2.117388 pass
11.707788 5.337136 pass
7.149973 6.062934 pass
0.553332 -5.238659 pass
1.601453 -5.067627 pass
1.697829 -5.631014 pass
-1.281275 -9.563286 pass
-4.963313 1.647943 pass
3.280159 -0.696398 pass
6.368050 6.503431 pass
0.456395 2.835656 pass
2.121554 1.834933 pass
5.167542 4.385102 pass
-1.183299 2.783353 pass
-2.226832 4.449976 pass
-4.049435 1.648257 pass
0.479416 -0.175025 pass
4.309084 2.687847 pass
-2.888835 5.073412 pass
1.185049 -5.021939 pass
7.481744 4.282897 pass
1.336729 5.707860 pass
-2.097355 -14.067451 pass
-3.550218 -8.627365 pass
-1.495641 -4.193355 pass
0.264942 3.178923 pass
-1.044110 -1.627526 pass
1.063166 -0.926363 pass
-1.226829 3.733089 pass
-3.144371 -8.905588 pass
-0.949059 -4.651874 pass
1.828050 2.373868 pass
1.634658 5.294717 pass
-0.842887 -2.478358 pass
-2.052110 1.271771 pass
-0.524211 -8.294072 pass
0.194050 -1.635924 pass
0.988922 8.337166 pass
-0.438410 2.537539 pass
-2.256193 4.053427 pass
0.928302 5.870448 pass
7.604687 1.557689 pass
2.956177 10.089741 pass
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits
Image mean, median and std 11.394609 10.827406 55.007805
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
608.5461714111817 2.5131153270429225 0.0008811535076687153 -0.014594743852346248
685.5165542363047 5.522005289569982 359.9985263490218 -0.014309429398466314
886.3377102041173 32.12032234845156 359.99243210897583 -0.012997421405947096
953.858650908105 37.038714754591744 359.99037445698593 -0.012674313169426505
444.4760693354769 61.921174725845646 0.006066872395400456 -0.013223584608591675
708.5375051993097 73.05653065791925 359.9979904139565 -0.012224485327696166
373.6920713251912 82.73362445593573 0.008291490212003361 -0.012772364504572807
429.1710480615856 96.9361473590585 0.0066252915340002895 -0.012205382067991825
486.33656507950644 111.0929968883717 0.004907122116154008 -0.011634266764592633
812.8169111357602 135.61175256667016 359.9949511037864 -0.010070911221503798
550.2506815991629 143.0082980431957 0.003027367540328657 -0.010506347247348124
856.666574138678 163.94025852158114 359.99367952721065 -0.009101828365468878
943.4725862005791 165.1160847976937 359.9910202493613 -0.008847595467969826
379.36603019242443 175.61024962497083 0.008352922362656737 -0.009943329177441321
390.9868475960879 182.23166489994372 0.008013379965691413 -0.009712585890208804
464.7874252509071 193.62567333213758 0.00577907114864779 -0.009180140912869495
706.4641169351513 205.44112744056818 359.99839593680207 -0.00821509388991974
471.0128665836423 208.50627769129127 0.005626261725713367 -0.008710551901505456
848.6275210111238 225.06047475891756 359.9940867921008 -0.007263151929571056
717.2689344128596 238.78521514635145 359.99815195717895 -0.00717032006242251
640.8223349387042 287.3876388648545 0.0006239692904470007 -0.005872559700757004
696.649043669952 311.4598971472418 359.9989761683857 -0.004996162404240498
534.5084442349707 350.37099693129943 0.004046577556716191 -0.00420410034973628
432.09618931856727 418.3419770115535 0.00735717883136822 -0.0023714315343018777
665.3849005558758 444.0678377273824 0.00028665146587420707 -0.0009971980130367556
704.8443491573435 454.5162471160152 359.99910711974667 -0.0005791581225037081
397.16046445276737 455.04418207058586 0.008519434584673621 -0.0013306377093679634
670.369979887094 468.54191939872646 0.00019949283603036086 -0.00023163279961321113
857.0397112859981 554.7274188893667 359.99472481101884 0.002868709976703097
890.8578568837343 564.4940272892437 359.9937177677001 0.0032484046780216053
971.7393022215407 581.0309188009905 359.9912903836618 0.00394462536976469
769.8173270515161 587.4004878427158 359.9974804771503 0.0036666311271152862
815.465578086775 621.703407654051 359.99618011089166 0.004829559764486471
457.30976496488194 695.4853021868445 0.007299335355773578 0.006221141229410244
663.7519356998866 727.5614345432715 0.001095655178011445 0.0077183669280205805
956.3618069104094 732.7218311115429 359.992187007799 0.008563535989006233
762.0142852652106 738.3497994697638 359.9981306929402 0.008284724036588096
475.77984981811954 787.1204617950921 0.006972951205655511 0.009078893288449403
820.4530900979327 846.8571043631532 359.99664763153703 0.011744432795549499
775.2564955710666 852.7653273770777 359.9980392843252 0.011819147585457136
821.2501449789805 862.1642779577346 359.99666536047 0.01221413713982896
811.2847022881816 907.0118295127575 359.99709126416207 0.013560419393838364
979.8325668501478 908.565764385858 359.99196472886814 0.01399450816804262
798.8585276961667 917.6911602746128 359.9974982346854 0.013857220326868504
757.3271158499823 919.1512240355106 359.9987646179659 0.013804049958067223
897.3858508178394 936.7555527010198 359.9945537040557 0.014666947106948183
628.02654407017 974.7375500319221 0.0028386785543619677 0.015187777746555775
456.3583448650907 987.6657631916269 0.008076558329031239 0.015153471999927788
RA_Diff (mas) Dec_diff (mas) pass/fail
-4.975323 3.779849 pass
-2.755133 4.393177 pass
-1.254723 -4.312847 pass
1.049522 2.224555 pass
12.056479 5.654166 pass
7.045844 6.047775 pass
0.643793 -5.153523 pass
1.717741 -4.927942 pass
1.564505 -5.895754 pass
-1.241359 -9.479059 pass
-4.926467 1.558064 pass
3.424340 -0.384162 pass
6.451563 6.653054 pass
0.439618 2.639647 pass
2.009985 1.699200 pass
5.497958 4.217884 pass
-1.157204 2.799888 pass
-2.576429 4.131308 pass
-4.059377 1.495409 pass
0.431088 -0.569241 pass
4.206189 3.015345 pass
-2.649017 5.109818 pass
1.381183 -4.948669 pass
7.573631 3.919603 pass
1.490243 5.452820 pass
-2.392719 -13.891574 pass
-3.571924 -8.870440 pass
-1.520796 -3.961259 pass
0.256135 3.092714 pass
-0.976075 -1.770595 pass
1.645149 -1.127410 pass
-1.065399 3.409585 pass
-3.200790 -8.784848 pass
-1.105415 -4.593468 pass
1.764763 2.287784 pass
1.367876 5.090795 pass
-0.836280 -2.143159 pass
-1.825790 1.321921 pass
-0.680332 -8.244084 pass
0.392313 -1.517061 pass
0.942213 8.813155 pass
-0.279494 2.414961 pass
-2.302308 4.093703 pass
1.323145 5.949910 pass
8.097701 1.456315 pass
3.372487 10.461996 pass
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits
Image mean, median and std 11.459499 10.829639 55.680965
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
632.757520509536 43.52799873198921 0.0008804967979520648 -0.014626457969967293
709.8257801184594 47.507856164720145 359.99852516247785 -0.014311550857858348
910.5959218383333 74.15073580836673 359.99243330115337 -0.012997209251142885
978.1734916601412 79.09634950402457 359.99037406382115 -0.012674008968996101
468.7130887677887 103.70932107395348 0.006068286014852335 -0.01322360404683915
732.790984782116 114.80235210425441 359.99799208670777 -0.012224549793193257
397.984710427444 124.51324600589399 0.008291256163280063 -0.012770390494991906
453.48648150451567 138.5482319055374 0.006624203827780067 -0.012205946184055615
510.5826324979371 152.64448533976542 0.004908405341258196 -0.011634774691144639
837.2149603482594 177.1785834572367 359.9949499615408 -0.010070545641559236
574.5481104859573 184.43873533137992 0.003027600457347842 -0.010506876620650508
881.0720770864376 205.4811392291359 359.99367911021494 -0.00910047240755286
967.9227669585642 206.66121780659034 359.99101887212703 -0.00884787365368245
403.5962440387207 216.998785601212 0.008354373151629148 -0.00994252422160558
415.2777583527195 223.52829021424284 0.008012874091052141 -0.009713721429904707
489.0920184154513 234.93882953827853 0.005778885460870573 -0.009179436773304156
730.7977037082132 246.70779432945926 359.99839704252184 -0.008216395799283889
495.33441450714344 249.70017562299645 0.005625489983602337 -0.008712222746655486
873.0776664428001 266.42458939825514 359.9940861819049 -0.00726229994756828
741.6867097679047 279.9382786626609 359.99815100970363 -0.007172803098400693
380.14033396361117 301.2436539679342 0.009287748779498183 -0.007423548358097951
665.2235848015512 328.5104074590912 0.0006236098759626848 -0.005872363696826033
721.1009889243013 352.48437128381073 359.99897510732956 -0.004998591785375306
558.8356054855649 391.3900339558093 0.004047855226464509 -0.004203748397144104
456.46867164126957 459.2609164373239 0.0073561127832601925 -0.002371745888469407
689.8327353648502 485.06169266959915 0.00028755014973561054 -0.0009973537094344351
729.3781725739266 495.5207376473076 359.9991061775121 -0.0005793868444065472
421.5313298328499 495.9474141851409 0.00851819173856682 -0.0013308055493282981
694.8390061976295 509.5305205319393 0.00020019156541582563 -0.0002319329312739653
14.081606885276077 557.2166447486212 0.021107528702098505 -0.0005205285248208323
881.6543299915564 595.8568645041335 359.9947254230886 0.0028688929381400895
915.4735869466531 605.5705900525442 359.9937187373024 0.0032461369049492667
996.4781613563033 622.2440029897667 359.9912890038844 0.003944930128583014
794.4678033778682 628.5049053250357 359.99747921198633 0.003667173736498765
840.081104132367 662.8420150991536 359.9961810901739 0.0048294298273538795
481.7458734746978 736.5408482211899 0.007300242502125687 0.006221561579575905
688.4363469452317 768.8245040889547 0.0010937407243143905 0.00772151655478467
981.1057496757138 774.1328899034736 359.99218742384153 0.00856640104398379
786.7033611257062 779.6094428435799 359.99813025456774 0.008285777187910513
500.3213435066071 828.2875623678548 0.006972292739396447 0.009079392487024846
845.1395260116918 888.2486429009447 359.9966490980914 0.011744618340666048
799.9582256550444 894.1529473093893 359.9980397938047 0.011819651703137203
845.956261130645 903.5178548940592 359.99666619433395 0.012212638460852125
835.9945894894588 948.4929444611175 359.99709237310265 0.013561331318791536
1004.5948488048369 950.0992666738197 359.9919654017713 0.013995388320326398
823.5753939434358 959.1642392517674 359.9974990166614 0.013857674611357278
782.0375957577447 960.5590014045085 359.99876499345754 0.013802953255150834
922.1356667374224 978.2850292332223 359.9945543794388 0.014667538039234738
652.6937363556877 1016.2119840128314 0.0028391970295941005 0.015188260679953809
RA_Diff (mas) Dec_diff (mas) pass/fail
-3.623553 -0.168281 pass
0.059981 6.028601 pass
1.980539 -4.873354 pass
-2.866220 0.193737 pass
7.784920 -1.983088 pass
3.634933 -2.891154 pass
-3.193980 -6.285198 pass
-2.836849 -2.974549 pass
-2.909741 -6.499978 pass
-8.133392 1.859597 pass
0.353129 2.226026 pass
1.053862 1.412953 pass
4.254858 9.720189 pass
5.059229 0.811112 pass
3.996774 9.099333 pass
0.709307 4.538448 pass
-0.742303 5.946131 pass
1.029653 1.425431 pass
-2.960956 -1.392640 pass
0.386387 -5.730427 pass
-0.904394 -1.974089 pass
1.343169 8.392748 pass
-3.586016 -3.851537 pass
3.461547 5.235690 pass
7.512148 5.220745 pass
0.873008 -12.378314 pass
-2.074170 1.443758 pass
3.078815 -2.694230 pass
-0.412341 5.627616 pass
1.446377 1.397953 pass
0.229756 -0.032288 pass
1.365980 5.536941 pass
0.324626 -9.252622 pass
-2.683556 -0.802124 pass
0.922188 9.394218 pass
-0.453272 1.002852 pass
2.654289 -10.307142 pass
0.689635 0.241447 pass
1.523119 -7.585423 pass
4.684152 -0.753304 pass
8.988473 -1.648692 pass
-1.836059 2.798112 pass
4.943346 5.312802 pass
0.699602 -1.301541 pass
2.161646 4.044166 pass
3.139657 0.454847 pass
7.353079 5.775123 pass
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits
Image mean, median and std 11.461396 10.8295555 55.684906
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
632.7561014527342 43.52872182023289 0.0010205421837794608 -0.014486439834403033
709.8260670657803 47.5058809583951 359.9986651486738 -0.014171609453174118
910.5951520227544 74.15262735916836 359.99257332956284 -0.012857154436161493
978.1739871993807 79.0963228230719 359.9905140485703 -0.012534008485688053
468.71224848996206 103.70989382247947 0.006208313253700151 -0.013083588821216326
732.7915923131342 114.80647731539594 359.9981320786759 -0.012084423456772018
397.98413357499743 124.51335799099897 0.008431274139434002 -0.012630388543481575
453.486222463101 138.5458169269537 0.006764205617381574 -0.01206602013451995
510.58256909558963 152.6453203832899 0.005048409422882343 -0.011494749469333973
837.2169099602804 177.17912292467238 359.9950899031489 -0.009930524368498101
574.5467924282938 184.53495588155457 0.003167889289769068 -0.010363947947852328
881.072757297264 205.48539115095912 359.99381910057497 -0.00896034135706193
967.924538456573 206.66197471295982 359.99115881981544 -0.008707846239862494
403.59519404561934 216.99772079775687 0.008494402627499458 -0.009802559375285612
415.27622730365823 223.52761937893004 0.008152919316814486 -0.009573745776052278
489.0946428106659 234.93889167070938 0.005918805147617917 -0.009039428286146166
730.7995005378147 246.70662956366752 359.99853698434373 -0.008076426945945311
495.33518932760904 249.7024097932946 0.005765471982520055 -0.008572152430679165
873.0774447239464 266.42532686273233 359.994226190677 -0.007122277968077975
741.6859285461186 279.93870052952946 359.99829103477674 -0.007032792110813749
380.1370486212538 301.2438407112605 0.009427849888286459 -0.007283550963973088
665.2269225901222 328.50792691218294 0.0007635010274181508 -0.005732431596715987
721.1001264694142 352.4851006313926 359.99911513570277 -0.004858571502264583
558.8372234547588 391.38558179923365 0.004187794040580324 -0.004063881330548656
456.46151568364206 459.25963414936314 0.007496328276344708 -0.002231803493918642
689.8318563457915 485.05914533128765 0.00042757019837570275 -0.0008574342669445246
729.3758901700103 495.52228213954953 359.9992462514958 -0.0004393448326454394
421.5314421564851 495.9455044748265 0.008658183418549214 -0.001190864071148042
694.837657200127 509.5318564734783 0.00034023640497564313 -9.18950864308775e-05
14.081803113089986 557.2159960609778 0.02124752117466758 -0.000380547908810225
881.6523091352415 595.8547570266802 359.9948654790013 0.003008823453461035
915.4741065868286 605.5711695752242 359.9938587230354 0.0033861559121944463
996.4784351276294 622.2423567819199 359.99142899086496 0.004084880233595695
794.469839790824 628.5055976724658 359.99761915170114 0.0038071998360018613
840.0786466311152 662.8404021273825 359.9963211607397 0.004969374543000565
481.74592656195796 736.5414197031473 0.0074402423629929765 0.006361579245680676
688.4356820369527 768.8238940960294 0.0012337593295742879 0.00786149626021711
981.1089672696557 774.1361073647035 359.99232733469995 0.008706506831144933
786.7045617896734 779.611802202087 359.9982702244455 0.00842585228151213
500.32197626807886 828.2892825101978 0.007112277959974392 0.009219446706782949
845.1369459333854 888.244390359914 359.99678916491627 0.011884482514216926
799.9586443996288 894.1555172153749 359.99817978807744 0.011959731139923258
845.9561015097216 903.5187293444774 359.9968062015897 0.012352664779542435
835.9932678302781 948.4906491194473 359.99723240700996 0.013701258281230323
1004.5949500781727 950.1001812322297 359.99210540123534 0.01413541643042263
823.5785927457607 959.1670105496879 359.9976389269887 0.013997766512779123
782.0375591951885 960.5596213741295 359.9989049962459 0.01394297205959524
922.1365503429363 978.2855175769723 359.99469435389864 0.014807554933294118
652.6933028870272 1016.2125890007942 0.0029792117714372685 0.015328278029687408
RA_Diff (mas) Dec_diff (mas) pass/fail
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits
Image mean, median and std 11.166319 10.819193 52.431835
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
646.9460364189496 123.58824806720995 0.0008803409666353219 -0.01462544759401453
724.0252320146072 127.5820452764259 359.9985251448545 -0.014310524077353
924.8606761687124 154.24326052907645 359.9924329361845 -0.012996383566727537
992.45691902968 159.27374467532363 359.99037339685844 -0.012673064323221303
482.87053476521277 183.28959656865936 0.006068231603246421 -0.013222390879844007
747.0589422960411 194.39222695244513 359.9979919488258 -0.012223096373398978
412.11218706689084 203.90829274053294 0.008291045403339596 -0.012771385160995604
467.56583952342805 217.90372011464456 0.00662635936109802 -0.01220484372594049
524.7770858845939 231.89311550157834 0.0049079203445831455 -0.011633826109081785
851.5364944961776 256.5001400819646 359.99495137802734 -0.010069281024660396
588.705062769309 263.51085726272504 0.0030296502371099806 -0.010506455620478956
895.4584259369747 284.53409875070355 359.99367964554193 -0.0091047589609821
982.4255461949168 285.9202146860721 359.99101719217686 -0.008849400351720169
417.7174017858739 295.82945696890056 0.008353917643836436 -0.009945222372284788
429.4042633190108 302.3938491302124 0.008012662027330593 -0.009714355847956803
503.2698996261898 313.66457227896325 0.005778574588179 -0.009182449351832687
745.2283576279594 325.5350018038381 359.99839492246144 -0.008217355359381432
509.53867989539395 328.42412505899017 0.005624735426441953 -0.008713537241315246
887.5443812545439 345.2641690333635 359.9940862878344 -0.007265244786619
756.1049685736115 358.67865141799314 359.9981503199985 -0.00717342350491229
394.23291927272953 379.85017585787546 0.009287587812766219 -0.00742439167826378
679.5634066559268 407.0596025804446 0.0006242027742464089 -0.005873736972104611
735.4844061261805 431.0996831560591 359.99897662127745 -0.0049976416161509035
573.1313058171473 469.80286113326713 0.004047329109084021 -0.004205179593319682
470.5890419719976 537.6340474457602 0.007357930444448098 -0.00237327401915634
704.327058625501 563.4788329832742 0.00028666582563447254 -0.0009992064146646443
435.6105785039881 574.3863481872331 0.008520331771738035 -0.0013305748801799543
743.874891664683 573.9747828254133 359.9991067931344 -0.0005809777008637135
709.3557006099318 587.9666594324468 0.0001991739613351785 -0.00023358941671565873
27.531278375167513 635.8512293053622 0.021115014317358988 -0.0005216216890524824
896.4408422838092 674.4980277163539 359.99472377077933 0.0028676799548390266
930.3046944886573 684.334662079809 359.9937171097069 0.0032476367453057745
1011.3109434871345 701.0321927252717 359.99128955084143 0.003944579315404069
809.095857702636 707.1484044619239 359.99747998772455 0.0036660735530476296
854.7864857555858 741.5832025222157 359.99618146318284 0.0048288846011218705
496.042646678495 815.501330316961 0.00730043085322982 0.006226567438309456
702.974834779573 847.7555655541388 0.0010946992939119733 0.007721763324996789
995.9743233516383 853.1699976082482 359.9921875269867 0.008566666045003165
801.4327560408036 858.5945248989527 359.9981289789841 0.008286199706369223
514.6244381546285 907.3352544164048 0.006973482959273866 0.009079930104721341
859.8694947178157 967.5204508513665 359.99664969864597 0.011745747050078564
814.6347535333018 973.4206873951758 359.99804066679786 0.011820395007652196
860.6853482064994 982.8172971910304 359.9966667541225 0.01221360129934576
RA_Diff (mas) Dec_diff (mas) pass/fail
-1.203028 -11.543093 pass
4.893700 4.162587 pass
7.721476 1.713322 pass
1.151995 -5.124618 pass
3.349600 -11.786469 pass
-0.044192 -6.935209 pass
4.794378 -5.669569 pass
-4.682542 2.747970 pass
2.515126 6.289380 pass
5.338653 3.348377 pass
4.636204 -0.881232 pass
3.313240 4.226007 pass
5.923951 -6.332260 pass
2.400472 8.622028 pass
0.833772 5.792833 pass
-0.744716 -7.119723 pass
5.836599 -2.309818 pass
-1.483874 -5.010042 pass
-1.616971 -5.114465 pass
8.560898 9.788311 pass
7.015773 10.453056 pass
1.551072 5.642778 pass
-1.702848 2.397762 pass
1.184793 -7.846536 pass
-1.531483 -5.217667 pass
-2.171310 3.368436 pass
1.667458 -11.215436 pass
-7.275657 0.718943 pass
0.163452 5.813420 pass
-1.216702 -1.281053 pass
-3.205055 -4.907717 pass
-2.973739 -5.721900 pass
-4.425194 -11.952163 pass
3.370264 2.219160 pass
8.427480 1.988662 pass
-4.552465 -1.934069 pass
3.303518 -4.400540 pass
2.714841 2.164678 pass
9.540854 5.559766 pass
-2.908163 -5.041266 pass
-0.279139 2.320706 pass
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits
Image mean, median and std 11.167205 10.820021 52.420555
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
646.9454800415763 123.59122321380107 0.0008803656879164385 -0.014625358834867506
724.0256726768248 127.58013796160934 359.9985251264132 -0.01431058074881553
924.8597080043684 154.2432706124099 359.99243296590157 -0.012996385708730001
992.4534255006282 159.2718625921307 359.9903734990552 -0.012673130090554478
482.8696673425391 183.2899835191299 0.006068259202637669 -0.013222381265036554
747.0578849106864 194.39226082259032 359.9979919813537 -0.012223097981552028
412.1139269048188 203.90945048821695 0.00829099500464183 -0.012771345469780142
467.56675428766414 217.9036290726527 0.0066263310760417415 -0.01220484420928609
524.7779965210373 231.88761492892587 0.004907878219448835 -0.011633991987964873
851.5351015628255 256.50133330428804 359.9949514239217 -0.010069248022576957
588.7056787681511 263.50878787844727 0.003029625957239504 -0.01050651745401577
895.4613105651895 284.53301855679746 359.9936795541991 -0.009104784903560181
982.4265095675484 285.9188137972235 359.99101715886314 -0.008849440744045681
417.71543674308754 295.8303503510455 0.008353980132200288 -0.00994519994298999
429.4043006594748 302.391294319142 0.008012654340806747 -0.009714434124611955
503.2701695686526 313.660954522638 0.005778556956879143 -0.009182559722200206
745.227175719965 325.53650613651814 359.99839496270187 -0.008217312112789378
509.5395129140925 328.4264116852812 0.005624715832518511 -0.008713464923489102
887.5432061951202 345.2660055868902 359.9940863288323 -0.007265191349839529
756.1041842849181 358.6800425484636 359.9981503477614 -0.007173382702703706
394.23237537998807 379.85139546326104 0.009287607567243169 -0.007424355561664159
679.5646720105382 407.0614691793956 0.0006241690117001846 -0.0058736764496161555
735.4846227401789 431.0987984975643 359.99897661226294 -0.004997668302282632
573.1327307968371 469.8028377674046 0.004047285469453377 -0.004205176771126612
470.5899109886719 537.634139560142 0.007357904143361665 -0.0023732689841836083
704.3299938731695 563.4795835368527 0.00028657817169840187 -0.0009991762174390486
435.6099546323682 574.3867880651862 0.008520351938341926 -0.0013305629301788556
743.876859351675 573.9722780891316 359.99910672620973 -0.000581050034878793
709.353752512589 587.9671313943018 0.00019923473444689437 -0.0002335795982129045
27.528381239185606 635.852642005663 0.021115105964276147 -0.0005215862798103629
896.4397012609306 674.5007838620852 359.9947238133093 0.002867761902645875
930.3064781430503 684.334060840617 359.9937170535473 0.003247622400811566
1011.3112434924527 701.0314437239015 359.99128953955324 0.003944557036107322
809.0957248208425 707.1478396927572 359.99747999022435 0.003666055911212994
854.7882520124947 741.5815247429309 359.99618140466794 0.004828837272518164
496.0419398685006 815.5016620469418 0.007300453193028751 0.0062265758102119555
702.9741875563504 847.7562918805631 0.0010947209288824965 0.007721783980913229
995.9721439659877 853.1689695028363 359.99218759056447 0.008566629720873442
801.4316652320226 858.5921814993368 359.9981290057719 0.008286125536795407
514.6267263594901 907.3369596675094 0.00697341792737487 0.009079987884410582
859.8707171877863 967.5196606903338 359.99664965931487 0.011745725802043364
814.6354876594828 973.4205911145488 359.99804064422983 0.011820393789056067
860.6851506594377 982.8162979189045 359.99666675739485 0.012213570408960222
RA_Diff (mas) Dec_diff (mas) pass/fail
-1.518582 -11.434383 pass
4.791874 4.160847 pass
7.655088 1.509304 pass
1.251941 -4.977730 pass
3.254916 -11.768343 pass
-0.035192 -6.998720 pass
4.866978 -5.626549 pass
-4.604656 2.822331 pass
2.373534 6.212887 pass
5.104539 3.556384 pass
4.783796 -0.688859 pass
3.161590 3.628843 pass
5.595117 -6.425653 pass
2.319227 8.617641 pass
0.933129 5.827446 pass
-0.985645 -7.380126 pass
5.804147 -2.405888 pass
-1.412758 -4.880022 pass
-1.657608 -5.194670 pass
8.726118 9.907119 pass
7.132873 10.447266 pass
1.631495 5.672917 pass
-1.473968 2.266995 pass
1.027690 -7.836376 pass
-1.594955 -5.615000 pass
-1.803401 3.131674 pass
1.456805 -11.385819 pass
-7.179221 0.451932 pass
-0.017983 5.956309 pass
-1.244373 -1.562849 pass
-3.407230 -4.959357 pass
-2.754956 -5.686554 pass
-4.272087 -11.657150 pass
3.477246 2.211449 pass
8.516476 2.308194 pass
-4.623003 -1.673725 pass
3.528476 -4.319795 pass
2.726621 2.053472 pass
9.453446 5.337166 pass
-3.028093 -5.186679 pass
-0.134273 2.476394 pass
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits
Image mean, median and std 11.14942 10.819677 52.3238
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- -----------------------
695.2882988999536 103.10651467532003 0.0008800008772832899 -0.014624813910079982
772.3744183009295 107.0815682195305 359.9985245931245 -0.014309869787115948
973.228381685913 133.63302595063803 359.99243224223216 -0.012997673379714877
531.2457880501139 162.90678044840305 0.006067753827247839 -0.013222863142923662
795.4098654036351 173.99541287004112 359.9979911433319 -0.012223925183360086
460.547711377863 183.5249036196875 0.008289441834595316 -0.012772358696295038
515.9706963233565 197.55498823067623 0.006625409028767752 -0.012205661433268716
573.1045796641623 211.60813499707166 0.004909149394200925 -0.01163371221201762
899.8933788590772 236.19645940742822 359.9949503013732 -0.010070332329877986
637.0838241772371 243.32047754138887 0.00302930239325246 -0.010504872055279972
943.8044405646633 264.45023347848417 359.9936793323863 -0.009100426256506654
466.16761385963326 275.6415362787146 0.008353364238678336 -0.00994304344948607
477.7998425311254 282.12836328156897 0.008013547610210205 -0.009714975271219643
551.6424228064568 293.5141692246144 0.005779824893848046 -0.009180675245526442
793.5362941129501 305.3737976889193 359.99839615145964 -0.008218045255784857
557.9115612743607 308.2309333789397 0.005626000043587533 -0.008713509112374706
935.89818015132 325.1387934464577 359.9940855059957 -0.00726544155060442
804.4990143921109 338.5651047740593 359.9981491833879 -0.0071737216779422215
442.6930855595648 359.6109073627168 0.009288286507927042 -0.007424822264389844
727.9952424701189 386.98027318926063 0.0006232392478226067 -0.005873735036980789
783.9187945939353 411.06018073336685 359.9989753985937 -0.00499750078331377
621.5759401883365 449.7014536319138 0.00404829003612404 -0.004205284148308415
519.1902540839886 517.5298630654247 0.007357057943188697 -0.002371136402893473
752.7897384965033 543.479054423098 0.00028734675743388586 -0.0009989984751563358
484.25480678313863 554.161793091394 0.008519257795758167 -0.001330984310451842
792.3715451848047 553.9949623101498 359.9991060833142 -0.0005807988134908488
757.8281459003109 567.9717563455148 0.00019999925135859084 -0.0002333580126112227
396.18338983138534 604.5780857775677 0.01133613097965103 -3.5146940737205506e-06
76.35854360332827 615.2713546165651 0.021113604528003087 -0.0005212509629759039
944.8620518533836 654.6300422676247 359.9947249668796 0.0028684712215900337
978.7199582266016 664.4764120134141 359.9937180442408 0.00324823477261302
857.5978321036471 687.1863850362278 359.9974808060295 0.0036657619234262495
903.3383272720531 721.6639082807033 359.99618069821037 0.004829340458761752
544.822969770774 795.1767613387013 0.007300501536278909 0.00622535560971207
751.6593136994991 827.6341518190358 0.0010951813293202872 0.0077212194450194584
850.0297444326784 838.5511439029677 359.99813041047923 0.008285502452127409
563.5070365304637 886.9914021805405 0.006972577193303109 0.009079660723682728
908.5174896745665 947.4667033713542 359.99665071218845 0.01174530799753924
863.3821582485261 953.31539644542 359.99803984272904 0.011819834480523251
909.4201911354062 962.7615722742491 359.9966654557789 0.012213561507437893
899.4889080888873 1007.7029930107033 359.9970911156624 0.013559580759199472
845.5160643327326 1019.3354165427019 359.9987631926184 0.0137889507124076
887.0452334515168 1018.3645917674779 359.9974986040853 0.013855459901527773
RA_Diff (mas) Dec_diff (mas) pass/fail
-1.425293 -1.944355 pass
1.248327 -10.794511 pass
1.472504 1.218840 pass
5.735248 4.068766 pass
-2.939804 -6.198041 pass
0.208595 -4.091050 pass
2.901706 -8.057076 pass
0.928065 -7.143518 pass
-2.947214 0.790002 pass
6.163878 4.708791 pass
2.077896 2.378605 pass
1.821585 -1.589582 pass
7.737819 4.636037 pass
4.796591 9.265477 pass
-0.566175 6.604130 pass
-0.886222 4.092685 pass
-3.300069 -6.475729 pass
1.434937 -1.802820 pass
1.031429 -6.560152 pass
-3.183615 2.090733 pass
4.684943 6.003612 pass
4.115995 7.469340 pass
1.805531 1.280195 pass
4.644130 -8.222934 pass
2.969618 1.169116 pass
-1.086443 -9.574348 pass
-2.122275 -1.791172 pass
-5.609395 2.308693 pass
1.971397 -3.510976 pass
0.159267 -2.754819 pass
-0.002695 -4.888845 pass
-0.119234 -9.103602 pass
0.872036 -2.424167 pass
7.203158 4.269924 pass
0.000157 -1.832805 pass
1.311259 3.443582 pass
-1.959196 2.021427 pass
8.288616 11.260601 pass
4.145255 -0.162921 pass
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits
Image mean, median and std 11.148314 10.819933 52.31703
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
695.28794170584 103.10641319490699 0.0008800115795231863 -0.01462481787900968
772.3731936505352 107.08007937646431 359.9985246268782 -0.014309917872403828
973.2281832908834 133.6348268676595 359.992432252969 -0.012997619538201288
531.2461240972619 162.90616024026545 0.006067741924447004 -0.013222881168460607
795.4082883628598 173.9964145346605 359.99799119432987 -0.01222389869223297
460.5482539991836 183.52565213354322 0.008289427105149128 -0.012772334529918135
515.971022928771 197.55386309448286 0.006625396116303293 -0.012205694933804823
573.1055169320389 211.6075876893692 0.0049091192277255415 -0.011633726576394846
899.8952017510751 236.19527724644132 359.99495024232874 -0.010070363843153046
637.082904882704 243.32193769850684 0.003029334402767267 -0.01050482968984714
943.7992653146599 264.4489310792786 359.99367948756526 -0.009100478721790392
466.1660535560782 275.640950154766 0.008353410553245011 -0.009943065336091812
477.79796528347913 282.1275102677306 0.008013602946853783 -0.009715006139339866
551.6441749526855 293.5150245290313 0.005779773415525509 -0.009180644632308558
793.5314353855134 305.37140487562107 359.9983962940064 -0.00821813048577351
557.9109575174925 308.23135130802393 0.005626019634737101 -0.008713497795483575
935.8973036748098 325.14009061951293 359.9940855363827 -0.007265403985229679
804.4988427398484 338.56293884484654 359.9981491828204 -0.007173788531946998
442.6927137354523 359.6114345294081 0.009288299245937747 -0.007424807000506554
727.9943724390052 386.9821714885887 0.0006232709857077299 -0.005873678813221203
783.9162233378428 411.0579407438311 359.9989754712712 -0.004997575863914036
621.5767698477409 449.70199238928535 0.004048266080364153 -0.004205265514444473
519.1911503353462 517.5358092205225 0.0073570460586275645 -0.0023709510343529468
752.7880780342024 543.4801203561428 0.0002874004121121975 -0.000998969663921725
484.25376556038856 554.1619772165304 0.00851929006313443 -0.0013309812693040395
792.3751873690417 553.9946415511126 359.9991059710994 -0.0005808000012685225
757.8304438957533 567.9695819856329 0.00019992310895048133 -0.0002334194004333699
396.18468311561935 604.5807611777432 0.011336098337038783 -3.429058731243893e-06
76.35814999540862 615.2723711714851 0.02111361895637598 -0.0005212208222102637
944.8635640932658 654.6310144514106 359.99472492340107 0.0028685045368420587
978.7205619653042 664.4790452486839 359.99371803321566 0.003248316935449173
857.5958244646582 687.1827860653182 359.9974808573291 0.0036656467929251264
903.3399724466342 721.6604165017714 359.99618063825375 0.004829237186174471
544.8233340592824 795.1777717322748 0.007300493096006179 0.006225387462063048
751.6584803677636 827.6363909001989 0.0010952127669043958 0.007721285965960717
850.0294380306964 838.55150947549 359.9981304208188 0.008285512920257644
563.5067284206251 886.9918823123108 0.006972587803690846 0.00907967462159978
908.5206742421236 947.4677816020749 359.9966506182584 0.01174534815537037
863.3827492499984 953.3136639288376 359.99803982000446 0.011819783039594491
909.4171471081825 962.7581389765916 359.99666553892456 0.012213449914027643
899.4888297651883 1007.7051953534469 359.99709112408334 0.013559647619545423
845.5162351428138 1019.3362542119728 359.99876318970763 0.013788976596931363
887.044887942196 1018.3648827073387 359.997498615383 0.01385546795957044
RA_Diff (mas) Dec_diff (mas) pass/fail
-1.384621 -1.915346 pass
1.441484 -10.690790 pass
1.426019 1.098238 pass
5.856762 3.895659 pass
-2.941847 -6.438715 pass
0.165811 -3.423724 pass
3.086385 -8.471545 pass
1.044227 -7.132569 pass
-2.834039 1.029477 pass
5.825730 4.853359 pass
2.116093 2.428638 pass
1.930978 -1.454347 pass
7.629220 4.584325 pass
5.355235 9.076602 pass
-0.647984 6.418943 pass
-0.929072 4.027794 pass
-3.704042 -6.480005 pass
1.696576 -2.073110 pass
1.077285 -6.505202 pass
-3.153300 2.331430 pass
4.472383 5.890165 pass
4.299587 7.564708 pass
1.775146 1.394863 pass
4.557889 -8.155852 pass
2.784296 1.279324 pass
-1.302286 -9.946130 pass
-2.085052 -1.753487 pass
-5.662421 2.395692 pass
2.170609 -3.622102 pass
0.119576 -2.459032 pass
-0.276808 -5.109842 pass
-0.275756 -8.983667 pass
0.910688 -2.230338 pass
7.241686 4.255636 pass
0.070685 -1.792064 pass
1.477992 3.364790 pass
-1.659872 1.619690 pass
8.403850 11.413117 pass
4.658423 -0.469749 pass
RA difference mean, median and std (units in mas) 1.1084997025612093 0.928302277808206 3.5773131993903524 Dec difference mean, median and std (units in mas) -0.17537865973407207 1.1691161048078824 5.539940734870295
Alter any parameters needed to get better results from tweakreg. Look at individual i2d images afterwards.
# Run Calwebb_image3 on the association table with tweakreg on
# set any specific parameters
# tweakreg parameters to allow data to run
fwhm = 3.318 #3.27 # Gaussian kernel FWHM of objects expected, default=2.5
minobj = 5 # minimum number of objects needed to match positions for a good fit, default=15
snr = 40 # signal to noise threshold, default=5
sigma = 3 # clipping limit, in sigma units, used when performing fit, default=3
fit_geom ='rshift' # ftype of affine transformation to be considered when fitting catalogs, default='general'
use2dhist = False # boolean indicating whether to use 2D histogram to find initial offset, default=True
search_radius = 1.0 # radius in arcseconds to search for a match
tol = 1.0 # Matching tolerance for xyxymatch in arcsec. (Default=1.0)
use2dhist = True # boolean indicating whether to use 2D histogram to find initial offset, default=True
pipe3=Image3Pipeline()
pipe3.tweakreg.kernel_fwhm = fwhm
pipe3.tweakreg.snr_threshold = snr
pipe3.tweakreg.minobj = minobj
pipe3.tweakreg.sigma = sigma
pipe3.tweakreg.fitgeometry = fit_geom
pipe3.tweakreg.use2dhist = use2dhist
pipe3.tweakreg.save_catalogs = True
#pipe3.tweakreg.skip = True # test to see if this affects the final output
pipe3.outlier_detection.skip = True
pipe3.source_catalog.save_results = True
pipe3.save_results = True
#pipe3.output_dir = datadir
# run Image3
#im = pipe3.run(rtdata.input)
image = pipe3.run('starfield_50star4ptdither_asnfile.json')
print('Image 3 pipeline finished.')
2021-10-30 15:34:48,550 - stpipe.Image3Pipeline - INFO - Image3Pipeline instance created.
2021-10-30 15:34:48,552 - stpipe.Image3Pipeline.assign_mtwcs - INFO - AssignMTWcsStep instance created.
2021-10-30 15:34:48,554 - stpipe.Image3Pipeline.tweakreg - INFO - TweakRegStep instance created.
2021-10-30 15:34:48,555 - stpipe.Image3Pipeline.skymatch - INFO - SkyMatchStep instance created.
2021-10-30 15:34:48,557 - stpipe.Image3Pipeline.outlier_detection - INFO - OutlierDetectionStep instance created.
2021-10-30 15:34:48,558 - stpipe.Image3Pipeline.resample - INFO - ResampleStep instance created.
2021-10-30 15:34:48,560 - stpipe.Image3Pipeline.source_catalog - INFO - SourceCatalogStep instance created.
2021-10-30 15:34:48,705 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline running with args ('starfield_50star4ptdither_asnfile.json',).
2021-10-30 15:34:48,710 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'steps': {'assign_mtwcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'assign_mtwcs', 'search_output_file': True, 'input_dir': ''}, 'tweakreg': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': True, 'catalog_format': 'ecsv', 'kernel_fwhm': 3.318, 'snr_threshold': 40, 'brightest': 1000, 'peakmax': None, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 1.0, 'use2dhist': True, 'separation': 0.5, 'tolerance': 1.0, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'rshift', 'nclip': 3, 'sigma': 3, 'align_to_gaia': False, 'gaia_catalog': 'GAIADR2', 'min_gaia': 5, 'save_gaia_catalog': False}, 'skymatch': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'global+match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '0', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}, 'outlier_detection': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}, 'source_catalog': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 100, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 5, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}}}
2021-10-30 15:34:48,806 - stpipe.Image3Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits' reftypes = ['abvegaoffset', 'apcorr', 'drizpars']
2021-10-30 15:34:48,809 - stpipe.Image3Pipeline - INFO - Prefetch for ABVEGAOFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf'.
2021-10-30 15:34:48,812 - stpipe.Image3Pipeline - INFO - Prefetch for APCORR reference file is '/grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits'.
2021-10-30 15:34:48,813 - stpipe.Image3Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:34:48,815 - stpipe.Image3Pipeline - INFO - Starting calwebb_image3 ...
2021-10-30 15:34:49,712 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg running with args (<ModelContainer>,).
2021-10-30 15:34:49,715 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': True, 'catalog_format': 'ecsv', 'kernel_fwhm': 3.318, 'snr_threshold': 40, 'brightest': 1000, 'peakmax': None, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 1.0, 'use2dhist': True, 'separation': 0.5, 'tolerance': 1.0, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'rshift', 'nclip': 3, 'sigma': 3, 'align_to_gaia': False, 'gaia_catalog': 'GAIADR2', 'min_gaia': 5, 'save_gaia_catalog': False}
2021-10-30 15:34:49,958 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 48 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits.
2021-10-30 15:34:49,963 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal_cat.ecsv
2021-10-30 15:34:50,227 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 48 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits.
2021-10-30 15:34:50,231 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal_cat.ecsv
2021-10-30 15:34:50,492 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 49 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits.
2021-10-30 15:34:50,497 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal_cat.ecsv
2021-10-30 15:34:50,775 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 48 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits.
2021-10-30 15:34:50,779 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal_cat.ecsv
2021-10-30 15:34:51,055 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 42 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits.
2021-10-30 15:34:51,058 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal_cat.ecsv
2021-10-30 15:34:51,326 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 42 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits.
2021-10-30 15:34:51,330 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal_cat.ecsv
2021-10-30 15:34:51,588 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 43 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits.
2021-10-30 15:34:51,592 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal_cat.ecsv
2021-10-30 15:34:51,830 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 42 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits.
2021-10-30 15:34:51,834 - stpipe.Image3Pipeline.tweakreg - INFO - Wrote source catalog: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal_cat.ecsv
2021-10-30 15:34:51,853 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:51,854 - stpipe.Image3Pipeline.tweakreg - INFO - Number of image groups to be aligned: 8.
2021-10-30 15:34:51,855 - stpipe.Image3Pipeline.tweakreg - INFO - Image groups:
2021-10-30 15:34:51,883 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal':
2021-10-30 15:34:51,883 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal
2021-10-30 15:34:51,907 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal':
2021-10-30 15:34:51,908 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal
2021-10-30 15:34:51,933 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal':
2021-10-30 15:34:51,933 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal
2021-10-30 15:34:51,957 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal':
2021-10-30 15:34:51,958 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal
2021-10-30 15:34:51,982 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal':
2021-10-30 15:34:51,983 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal
2021-10-30 15:34:52,010 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal':
2021-10-30 15:34:52,012 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal
2021-10-30 15:34:52,040 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal':
2021-10-30 15:34:52,042 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal
2021-10-30 15:34:52,071 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal':
2021-10-30 15:34:52,072 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal
2021-10-30 15:34:52,073 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:52,073 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:52,074 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() started on 2021-10-30 15:34:52.073963
2021-10-30 15:34:52,075 - stpipe.Image3Pipeline.tweakreg - INFO - Version 0.7.3
2021-10-30 15:34:52,076 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:52,240 - stpipe.Image3Pipeline.tweakreg - INFO - Selected image 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' as reference image
2021-10-30 15:34:52,245 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2021-10-30 15:34:52,352 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:34:52,353 - stpipe.Image3Pipeline.tweakreg - INFO - Computing initial guess for X and Y shifts...
2021-10-30 15:34:52,355 - stpipe.Image3Pipeline.tweakreg - INFO - Found initial X and Y shifts of 0, 0 with significance of 48 and 52 matches.
2021-10-30 15:34:52,357 - stpipe.Image3Pipeline.tweakreg - INFO - Found 48 matches for 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal'...
2021-10-30 15:34:52,358 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:34:52,362 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal:
2021-10-30 15:34:52,363 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -4.99872e-05 YSH: -1.34437e-05 ROT: 5.32927e-05 SCALE: 1
2021-10-30 15:34:52,364 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:52,364 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.000287318 FIT MAE: 0.000256544
2021-10-30 15:34:52,365 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 48 objects.
2021-10-30 15:34:52,393 - stpipe.Image3Pipeline.tweakreg - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/wcs.py:1990: DeprecationWarning: Indexing a WCS.pipeline step is deprecated. Use the `frame` and `transform` attributes instead.
warnings.warn("Indexing a WCS.pipeline step is deprecated. "
2021-10-30 15:34:52,409 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2021-10-30 15:34:52,523 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:34:52,524 - stpipe.Image3Pipeline.tweakreg - INFO - Computing initial guess for X and Y shifts...
2021-10-30 15:34:52,526 - stpipe.Image3Pipeline.tweakreg - INFO - Found initial X and Y shifts of 0, 0 with significance of 47 and 51 matches.
2021-10-30 15:34:52,528 - stpipe.Image3Pipeline.tweakreg - INFO - Found 47 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal'...
2021-10-30 15:34:52,530 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:34:52,533 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal:
2021-10-30 15:34:52,534 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000321171 YSH: -4.24579e-05 ROT: -0.000894824 SCALE: 1
2021-10-30 15:34:52,535 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:52,536 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.00527931 FIT MAE: 0.00461642
2021-10-30 15:34:52,536 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 46 objects.
2021-10-30 15:34:52,577 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2021-10-30 15:34:52,689 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:34:52,690 - stpipe.Image3Pipeline.tweakreg - INFO - Computing initial guess for X and Y shifts...
2021-10-30 15:34:52,691 - stpipe.Image3Pipeline.tweakreg - INFO - Found peak in the 2D histogram lies at the edge of the histogram. Try increasing 'searchrad' for improved results.
2021-10-30 15:34:52,693 - stpipe.Image3Pipeline.tweakreg - INFO - Found initial X and Y shifts of 1, 1 with significance of 17.98 and 51 matches.
2021-10-30 15:34:52,694 - stpipe.Image3Pipeline.tweakreg - INFO - Found 47 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal'...
2021-10-30 15:34:52,697 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:34:52,701 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal:
2021-10-30 15:34:52,702 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.504339 YSH: -0.504285 ROT: -0.000801053 SCALE: 1
2021-10-30 15:34:52,702 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:52,703 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.00545887 FIT MAE: 0.00479425
2021-10-30 15:34:52,704 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 46 objects.
2021-10-30 15:34:52,745 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2021-10-30 15:34:53,011 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:34:53,013 - stpipe.Image3Pipeline.tweakreg - INFO - Computing initial guess for X and Y shifts...
2021-10-30 15:34:53,016 - stpipe.Image3Pipeline.tweakreg - INFO - Found initial X and Y shifts of 0, 0 with significance of 41 and 43 matches.
2021-10-30 15:34:53,019 - stpipe.Image3Pipeline.tweakreg - INFO - Found 41 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal'...
2021-10-30 15:34:53,021 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:34:53,025 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal:
2021-10-30 15:34:53,026 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000303586 YSH: 0.00105847 ROT: -0.000552349 SCALE: 1
2021-10-30 15:34:53,027 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:53,028 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.00771548 FIT MAE: 0.00684298
2021-10-30 15:34:53,028 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 40 objects.
2021-10-30 15:34:53,067 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2021-10-30 15:34:53,168 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:34:53,169 - stpipe.Image3Pipeline.tweakreg - INFO - Computing initial guess for X and Y shifts...
2021-10-30 15:34:53,171 - stpipe.Image3Pipeline.tweakreg - INFO - Found initial X and Y shifts of 0, 0 with significance of 41 and 43 matches.
2021-10-30 15:34:53,173 - stpipe.Image3Pipeline.tweakreg - INFO - Found 41 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal'...
2021-10-30 15:34:53,174 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:34:53,178 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal:
2021-10-30 15:34:53,179 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000286148 YSH: 0.00108692 ROT: -0.000523678 SCALE: 1
2021-10-30 15:34:53,180 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:53,181 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.00770516 FIT MAE: 0.00682456
2021-10-30 15:34:53,181 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 40 objects.
2021-10-30 15:34:53,224 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2021-10-30 15:34:53,326 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:34:53,327 - stpipe.Image3Pipeline.tweakreg - INFO - Computing initial guess for X and Y shifts...
2021-10-30 15:34:53,329 - stpipe.Image3Pipeline.tweakreg - INFO - Found initial X and Y shifts of 0, 0 with significance of 40 and 44 matches.
2021-10-30 15:34:53,331 - stpipe.Image3Pipeline.tweakreg - INFO - Found 40 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal'...
2021-10-30 15:34:53,332 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:34:53,335 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal:
2021-10-30 15:34:53,336 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000237614 YSH: 0.00262767 ROT: 0.000387146 SCALE: 1
2021-10-30 15:34:53,339 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:53,339 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.0110158 FIT MAE: 0.0068922
2021-10-30 15:34:53,340 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 39 objects.
2021-10-30 15:34:53,381 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2021-10-30 15:34:53,481 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2021-10-30 15:34:53,482 - stpipe.Image3Pipeline.tweakreg - INFO - Computing initial guess for X and Y shifts...
2021-10-30 15:34:53,484 - stpipe.Image3Pipeline.tweakreg - INFO - Found initial X and Y shifts of 0, 0 with significance of 40 and 44 matches.
2021-10-30 15:34:53,486 - stpipe.Image3Pipeline.tweakreg - INFO - Found 40 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal'...
2021-10-30 15:34:53,487 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'rshift' fit
2021-10-30 15:34:53,490 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'rshift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal:
2021-10-30 15:34:53,491 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.000265638 YSH: 0.00262238 ROT: 0.000458858 SCALE: 1
2021-10-30 15:34:53,493 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:53,494 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.0110242 FIT MAE: 0.00691673
2021-10-30 15:34:53,494 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 39 objects.
2021-10-30 15:34:53,532 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:53,534 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() ended on 2021-10-30 15:34:53.532954
2021-10-30 15:34:53,535 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() TOTAL RUN TIME: 0:00:01.458991
2021-10-30 15:34:53,535 - stpipe.Image3Pipeline.tweakreg - INFO -
2021-10-30 15:34:53,836 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg done
2021-10-30 15:34:54,025 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch running with args (<ModelContainer>,).
2021-10-30 15:34:54,027 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'global+match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '0', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}
2021-10-30 15:34:54,088 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:34:54,089 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() started on 2021-10-30 15:34:54.088668
2021-10-30 15:34:54,090 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:34:54,091 - stpipe.Image3Pipeline.skymatch - INFO - Sky computation method: 'global+match'
2021-10-30 15:34:54,092 - stpipe.Image3Pipeline.skymatch - INFO - Sky matching direction: DOWN
2021-10-30 15:34:54,093 - stpipe.Image3Pipeline.skymatch - INFO - Sky subtraction from image data: OFF
2021-10-30 15:34:54,094 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:34:54,095 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing differences in sky values in overlapping regions.
2021-10-30 15:35:00,867 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0109372
2021-10-30 15:35:00,869 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.022236
2021-10-30 15:35:00,870 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0132933
2021-10-30 15:35:00,870 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00937814
2021-10-30 15:35:00,871 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0
2021-10-30 15:35:00,872 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00884242
2021-10-30 15:35:00,872 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00383076
2021-10-30 15:35:00,873 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0136089
2021-10-30 15:35:00,874 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:35:00,875 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing "global" sky - smallest sky value across *all* input images.
2021-10-30 15:35:01,035 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:35:01,037 - stpipe.Image3Pipeline.skymatch - INFO - "Global" sky value correction: 10.812714931864468 [not converted]
2021-10-30 15:35:01,037 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:35:01,038 - stpipe.Image3Pipeline.skymatch - INFO - ---- Final (match+global) sky for:
2021-10-30 15:35:01,039 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8237 (old=0.0109372, delta=10.8127)
2021-10-30 15:35:01,040 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.835 (old=0.022236, delta=10.8127)
2021-10-30 15:35:01,043 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.826 (old=0.0132933, delta=10.8127)
2021-10-30 15:35:01,044 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8221 (old=0.00937814, delta=10.8127)
2021-10-30 15:35:01,044 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8127 (old=0, delta=10.8127)
2021-10-30 15:35:01,045 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8216 (old=0.00884242, delta=10.8127)
2021-10-30 15:35:01,046 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8165 (old=0.00383076, delta=10.8127)
2021-10-30 15:35:01,047 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8263 (old=0.0136089, delta=10.8127)
2021-10-30 15:35:01,048 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:35:01,049 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() ended on 2021-10-30 15:35:01.048495
2021-10-30 15:35:01,049 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() TOTAL RUN TIME: 0:00:06.959827
2021-10-30 15:35:01,050 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:35:01,065 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch done
2021-10-30 15:35:01,206 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection running with args (<ModelContainer>,).
2021-10-30 15:35:01,208 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None}
2021-10-30 15:35:01,209 - stpipe.Image3Pipeline.outlier_detection - INFO - Step skipped.
2021-10-30 15:35:01,215 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection done
2021-10-30 15:35:01,337 - stpipe.Image3Pipeline.resample - INFO - Step resample running with args (<ModelContainer>,).
2021-10-30 15:35:01,339 - stpipe.Image3Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:35:01,358 - stpipe.Image3Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:35:01,533 - stpipe.Image3Pipeline.resample - INFO - Blending metadata for starfield_50star4ptdither_combined.fits
2021-10-30 15:35:02,119 - stpipe.Image3Pipeline.resample - INFO - Resampling science data
2021-10-30 15:35:02,788 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:04,062 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:05,368 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:06,653 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:07,959 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:09,241 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:10,539 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:11,815 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:12,345 - stpipe.Image3Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:35:12,938 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:14,220 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:15,690 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:17,189 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:18,682 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:20,092 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:21,381 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:22,667 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:23,203 - stpipe.Image3Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:35:23,793 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:25,102 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:26,429 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:27,952 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:29,440 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:30,897 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:32,415 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:33,883 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:34,418 - stpipe.Image3Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:35:35,098 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:36,560 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:38,018 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:39,440 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:40,900 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:42,343 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:43,794 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:45,261 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:35:45,833 - stpipe.Image3Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:35:45,836 - stpipe.Image3Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021512893 -0.020377290 0.024586045 0.014642008 359.990548023 0.017629048 359.987474870 -0.017390249
2021-10-30 15:35:46,242 - stpipe.Image3Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_combined_i2d.fits
2021-10-30 15:35:46,243 - stpipe.Image3Pipeline.resample - INFO - Step resample done
2021-10-30 15:35:46,429 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog running with args (<ImageModel(1142, 1111) from starfield_50star4ptdither_combined_i2d.fits>,).
2021-10-30 15:35:46,431 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 100, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 5, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}
2021-10-30 15:35:46,453 - stpipe.Image3Pipeline.source_catalog - INFO - Using APCORR reference file /grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits
2021-10-30 15:35:46,462 - stpipe.Image3Pipeline.source_catalog - INFO - Using ABVEGAOFFSET reference file /grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf
2021-10-30 15:35:46,463 - stpipe.Image3Pipeline.source_catalog - INFO - Instrument: MIRI
2021-10-30 15:35:46,464 - stpipe.Image3Pipeline.source_catalog - INFO - Detector: MIRIMAGE
2021-10-30 15:35:46,465 - stpipe.Image3Pipeline.source_catalog - INFO - Filter: F1130W
2021-10-30 15:35:46,465 - stpipe.Image3Pipeline.source_catalog - INFO - Subarray: FULL
2021-10-30 15:35:46,504 - stpipe.Image3Pipeline.source_catalog - INFO - AB to Vega magnitude offset 5.49349
2021-10-30 15:35:46,944 - stpipe.Image3Pipeline.source_catalog - INFO - Detected 665 sources
2021-10-30 15:35:47,637 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote source catalog: starfield_50star4ptdither_combined_cat.ecsv
2021-10-30 15:35:47,732 - stpipe.Image3Pipeline.source_catalog - INFO - Saved model in starfield_50star4ptdither_combined_segm.fits
2021-10-30 15:35:47,734 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote segmentation map: starfield_50star4ptdither_combined_segm.fits
2021-10-30 15:35:47,735 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog done
2021-10-30 15:35:47,736 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline done
Image 3 pipeline finished.
# Get list of catalogs
cataloglist = [ele.replace('cal.fits', 'cal_cat.ecsv') for ele in imagelist]
print(imagelist)
print()
print(cataloglist)
['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits'] ['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal_cat.ecsv', 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal_cat.ecsv', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal_cat.ecsv', 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal_cat.ecsv', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal_cat.ecsv', 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal_cat.ecsv', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal_cat.ecsv', 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal_cat.ecsv']
# Loop through each image and overplot the sources found in the individual catalogs
index=0
for cal_image in imagelist:
indimage = ImageModel(cal_image)
ind_data = indimage.data
indcat = cataloglist[index]
catdata = table.Table.read(indcat, format='ascii', comment='#')
print(cal_image)
print(indcat)
print(len(catdata['xcentroid']), 'sources found')
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(ind_data, cmap='Greys', origin='lower', vmin=0,vmax=50)#, norm=norm)
plt.scatter(catdata['xcentroid'], catdata['ycentroid'],lw=1, s=20,color='red')
plt.show()
index = index+1
print()
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal_cat.ecsv 48 sources found
starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal_cat.ecsv 48 sources found
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal_cat.ecsv 49 sources found
starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal_cat.ecsv 48 sources found
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal_cat.ecsv 42 sources found
starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal_cat.ecsv 42 sources found
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal_cat.ecsv 43 sources found
starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal_cat.ecsv 42 sources found
im = ImageModel('starfield_50star4ptdither_combined_i2d.fits')
pixarea = im.meta.photometry.pixelarea_steradians
print('Pixel area in steradians', pixarea)
# pull out data portion of input file
data = im.data
# print stats on input image
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
Pixel area in steradians 2.84403609523084e-13 Image mean, median and std 1.9935058 0.0 46.597652
# Run DAOStarFinder to find sources in image
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
# using wcs info from images, put coordinates into RA, Dec
ra, dec = im.meta.wcs(sources['xcentroid'], sources['ycentroid'])
print('Number of sources found with DAOStarFinder: ',np.size(ra))
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
print()
# Put ra, dec coords into a table
cat1_sim = Table([RA_sim, Dec_sim], names=('ra', 'dec'))
cat2_calc = Table([ra, dec], names=('ra', 'dec'))
# Get coordinates with SkyCoord for each catalog
coord_cat1_sim = SkyCoord(ra=cat1_sim['ra'], dec=cat1_sim['dec'], unit="deg")
coord_cat2_calc = SkyCoord(ra=cat2_calc['ra'], dec=cat2_calc['dec'], unit="deg")
ind_cat2_cat1, dist_2d, _ = match_coordinates_sky(coord_cat1_sim, coord_cat2_calc)
# Find where the catalogs match
cat1_matched = cat1_sim[dist_2d.arcsec<0.05]
cat2_matched = cat2_calc[ind_cat2_cat1[dist_2d.arcsec<0.05]]
#print(cat1_matched)
# Get differences in RA, Dec
ra_diff = cat2_matched['ra'] - cat1_matched['ra']
dec_diff = cat2_matched['dec'] - cat1_matched['dec']
#print(ra_diff)
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
deltara_twon = []
deltadec_twon = []
# Compare input RA, Dec to found RA, Dec
print('RA_Diff (mas) Dec_diff (mas) pass/fail')
# Find if the differences are within the allowed 30 mas range
for i in np.arange(0,len(ra_diff)):
#if ra_diff[i] < 30 and dec_diff[i] < 30:
deltara_twon.append(ra_diff[i])
deltadec_twon.append(dec_diff[i])
if abs(ra_diff[i]) < 30 and abs(dec_diff[i]) < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {}'.format(ra_diff[i], dec_diff[i], test))
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in milliarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltara_twon,deltadec_twon)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
print()
print('Number of sources matched: ', np.size(deltara_twon))
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in milliarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltadec_twon,deltara_twon)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
meanRAdiff_twon, medianRAdiff_twon, stdRAdiff_twon = sigma_clipped_stats(deltara_twon, sigma=5.0, maxiters=5) # default sigma=3
meanDecdiff_twon, medianDecdiff_twon, stdDecdiff_twon = sigma_clipped_stats(deltadec_twon, sigma=5.0, maxiters=5) # default sigma=3
print('RA difference mean, median and std (units in mas)',meanRAdiff_twon, medianRAdiff_twon, stdRAdiff_twon)
print('Dec difference mean, median and std (units in mas)',meanDecdiff_twon, medianDecdiff_twon, stdDecdiff_twon)
Number of sources found with DAOStarFinder: 50
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
684.0349803475178 127.53398847357508 0.0008802356349855171 -0.014625718674439589
761.1417184139129 131.00120948123592 359.99852509670563 -0.014311900342310403
962.0440452065515 156.25972278818284 359.99243242129506 -0.012996717054371961
1029.5284666975513 160.74893688046848 359.99037509992735 -0.012677453291584553
520.1368420391211 187.64742742842017 0.0060679202916584405 -0.01322340143593345
784.3356555181539 197.08543276296302 359.9979916917405 -0.012223019740636542
449.51876262094385 208.5702341531882 0.008289719503480198 -0.01277184115109184
504.97946142834684 222.20944276391862 0.006625726974435659 -0.012204350142250334
562.1911587527698 235.79122459107828 0.004907885737979352 -0.011633908121258621
888.8695248012649 258.1098281845347 359.99495039095916 -0.010070410096154815
626.2027654910878 266.95476895333866 0.003028839063225088 -0.010506024616046442
932.7665482284115 285.86100799990163 359.99367897297964 -0.00910129523296116
1019.5595971185592 286.54167403975947 359.99101930586517 -0.008846860122599477
455.53239308527674 300.2762204599259 0.008352095533951685 -0.009943504779325039
467.14591851603143 306.7596321961596 0.008013415138457691 -0.009713439389314394
540.9630023310443 317.6493323919143 0.005779127153037693 -0.009180864192483209
782.6138199786066 327.8326068208079 359.99839633587135 -0.008218306204708078
547.2483322344721 332.38725496041053 0.005626048381679944 -0.008712013489893524
924.8281578801057 346.52711105446014 359.99408565695506 -0.007262338604858787
793.4822837317037 361.04776363726523 359.998152438575 -0.007170519891265439
432.43565280239363 384.483486807207 0.00928695850403594 -0.007423452556091411
717.231077383143 410.0464704240344 0.0006225299655050548 -0.0058731742743724545
773.0305174014436 433.6758458601374 359.9989750338148 -0.004998424338848544
611.1366566102249 473.76242187802603 0.00404736465091018 -0.004204834914927395
509.2259534347173 542.4939418737199 0.007357403154947366 -0.0023714351926040034
741.9307616274504 566.8597532887308 0.00028710582532826543 -0.0009980453346127183
781.3295347385974 577.0259012698879 359.9991063043381 -0.0005802783869730137
474.5394981831283 579.5208916724416 0.00852069988726074 -0.0013293502005542097
746.9307063279622 591.3670391447317 0.00019973287256415035 -0.0002330772232622418
387.19879468974204 630.3913820845227 0.01133588647267842 -4.448642699212251e-06
932.9197540139694 676.2487522261326 359.9947248190895 0.0028703123981259153
966.5603956890668 685.6064301157866 359.9937184144618 0.003247792392345676
1047.140106496161 701.2915932491753 359.9912896561644 0.003945618283834075
846.0149570836986 709.7840295074827 359.9974799890471 0.003664804669451385
891.3788417927829 743.7807052121145 359.9961803967219 0.0048293842710677905
535.5302155606583 820.560406068821 0.007299070436510209 0.006226226676257392
740.5198481161856 851.3192337057912 0.0010958596059167597 0.0077210752866773225
1031.2202059905437 853.4082027038969 359.9921871880379 0.008567415678337739
838.1002310858407 861.2212181284395 359.99813021484835 0.008287309933149136
554.2140041036906 911.9442379131407 0.006972050589896719 0.00907877997847797
895.8521765390282 968.8842002716821 359.99664898211694 0.011744194860677674
851.0617008995691 975.2989948756659 359.9980397392956 0.011820371445294985
896.6167928435669 984.1574554189473 359.9966666359951 0.012214605060812917
1053.848013257962 1028.4912998831144 359.9919644623725 0.013997210503445774
886.6562292761436 1028.9254355180256 359.99709254739616 0.013560605831766095
874.3946672046525 1039.7000372060936 359.9974975415373 0.013858011554924147
833.2149645062904 1041.4770548263025 359.9987650943972 0.013801687934361711
971.9370290209705 1057.5136099823094 359.99455435305737 0.014666751704994156
705.3404561026465 1097.9692714400207 0.0028383736662621574 0.015189901486236309
535.6924610909605 1111.682721439473 0.00807751332453303 0.015153895473991742
RA_Diff (mas) Dec_diff (mas) pass/fail
-3.260170 -4.723436 pass
-5.250466 7.241598 pass
0.380971 -7.363205 pass
2.617108 5.939488 pass
7.548140 -3.241232 pass
8.778870 5.328391 pass
1.451358 -5.166693 pass
-0.039430 -11.503190 pass
6.119594 -1.260722 pass
-0.505419 0.271032 pass
-0.064379 0.701498 pass
0.182124 -0.792077 pass
2.365038 9.581023 pass
3.188657 3.930763 pass
5.447968 3.223706 pass
3.502727 6.137161 pass
-2.254801 10.445350 pass
-0.938536 8.537203 pass
-0.286950 2.154831 pass
-2.504383 -4.602193 pass
0.121733 -5.127620 pass
-3.749385 -1.629202 pass
1.970626 5.780994 pass
-1.237808 -1.374178 pass
5.007453 5.723654 pass
6.090266 10.728934 pass
-3.346429 4.416035 pass
-2.923063 5.096442 pass
1.312743 -6.605694 pass
0.457751 0.488907 pass
-1.935459 7.957812 pass
3.959739 -12.431850 pass
1.271007 2.706138 pass
-2.171801 -9.416624 pass
-2.826546 4.715759 pass
-4.609787 4.171856 pass
1.494498 2.018198 pass
1.492062 -4.347388 pass
-0.961659 -3.878004 pass
-0.651278 -2.475367 pass
1.516662 1.018604 pass
8.048286 1.012772 pass
0.174174 3.551436 pass
-3.256078 1.782794 pass
2.289582 5.778219 pass
6.620628 7.111382 pass
4.701115 4.103559 pass
4.809137 -1.102337 pass
Number of sources matched: 48
RA difference mean, median and std (units in mas) 1.044712286909813 0.4193610587246662 3.4546813255954345 Dec difference mean, median and std (units in mas) 1.1378027151533245 1.9004964490206 5.561995692399732
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data, cmap='Greys', origin='lower', vmin=-5,vmax=10)#, norm=norm)
apertures.plot(color='red', lw=2.5) #, alpha=0.5)
plt.show()
# Take a closer look at a portion of the image to get a closer look at the psf
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data[350:450, 700:820], cmap='Greys', origin='lower', vmin=0,vmax=200)#, norm=norm)
#apertures.plot(color='red', lw=2.5) #, alpha=0.5)
#plt.scatter(sources['xcentroid']-700, sources['ycentroid']-350, color='red')
#plt.ylim(350,450)
#plt.xlim(700,820)
plt.show()
# Run Calwebb_image3 on the association table with tweakreg on
# set any specific parameters
# tweakreg parameters to allow data to run
fwhm = 3.318 #3.27 # Gaussian kernel FWHM of objects expected, default=2.5
minobj = 5 # minimum number of objects needed to match positions for a good fit, default=15
snr = 40 # signal to noise threshold, default=5
sigma = 3 # clipping limit, in sigma units, used when performing fit, default=3
fit_geom ='rshift' # ftype of affine transformation to be considered when fitting catalogs, default='general'
use2dhist = False # boolean indicating whether to use 2D histogram to find initial offset, default=True
#pipe3=Image3Pipeline()
#pipe3.tweakreg.kernel_fwhm = fwhm
#pipe3.tweakreg.snr_threshold = snr
#pipe3.tweakreg.minobj = minobj
#pipe3.tweakreg.sigma = sigma
#pipe3.tweakreg.fitgeometry = fit_geom
#pipe3.tweakreg.use2dhist = use2dhist
pipe3.tweakreg.skip = True # test to see if this affects the final output
pipe3.outlier_detection.skip = True
pipe3.source_catalog.save_results = True
pipe3.save_results = True
#pipe3.output_dir = datadir
# run Image3
#im = pipe3.run(rtdata.input)
image = pipe3.run('starfield_50star4ptdither_asnfile.json')
print('Image 3 pipeline finished.')
2021-10-30 15:35:55,685 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline running with args ('starfield_50star4ptdither_asnfile.json',).
2021-10-30 15:35:55,691 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpm6c8qze0/starfield_50star4ptdither_combined.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'image3pipeline', 'search_output_file': True, 'input_dir': '', 'steps': {'assign_mtwcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'assign_mtwcs', 'search_output_file': True, 'input_dir': ''}, 'tweakreg': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'tweakreg', 'search_output_file': True, 'input_dir': '', 'save_catalogs': True, 'catalog_format': 'ecsv', 'kernel_fwhm': 3.318, 'snr_threshold': 40, 'brightest': 1000, 'peakmax': None, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 1.0, 'use2dhist': True, 'separation': 0.5, 'tolerance': 1.0, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'rshift', 'nclip': 3, 'sigma': 3, 'align_to_gaia': False, 'gaia_catalog': 'GAIADR2', 'min_gaia': 5, 'save_gaia_catalog': False}, 'skymatch': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'skymatch', 'search_output_file': True, 'input_dir': '', 'skymethod': 'global+match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '0', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}, 'outlier_detection': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}, 'source_catalog': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 100, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 5, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}}}
2021-10-30 15:35:55,788 - stpipe.Image3Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits' reftypes = ['abvegaoffset', 'apcorr', 'drizpars']
2021-10-30 15:35:55,791 - stpipe.Image3Pipeline - INFO - Prefetch for ABVEGAOFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf'.
2021-10-30 15:35:55,793 - stpipe.Image3Pipeline - INFO - Prefetch for APCORR reference file is '/grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits'.
2021-10-30 15:35:55,795 - stpipe.Image3Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2021-10-30 15:35:55,796 - stpipe.Image3Pipeline - INFO - Starting calwebb_image3 ...
2021-10-30 15:35:56,683 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg running with args (<ModelContainer>,).
2021-10-30 15:35:56,685 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'tweakreg', 'search_output_file': True, 'input_dir': '', 'save_catalogs': True, 'catalog_format': 'ecsv', 'kernel_fwhm': 3.318, 'snr_threshold': 40, 'brightest': 1000, 'peakmax': None, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 1.0, 'use2dhist': True, 'separation': 0.5, 'tolerance': 1.0, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'rshift', 'nclip': 3, 'sigma': 3, 'align_to_gaia': False, 'gaia_catalog': 'GAIADR2', 'min_gaia': 5, 'save_gaia_catalog': False}
2021-10-30 15:35:56,686 - stpipe.Image3Pipeline.tweakreg - INFO - Step skipped.
2021-10-30 15:35:56,692 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg done
2021-10-30 15:35:56,804 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch running with args (<ModelContainer>,).
2021-10-30 15:35:56,806 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'skymatch', 'search_output_file': True, 'input_dir': '', 'skymethod': 'global+match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '0', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}
2021-10-30 15:35:56,898 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:35:56,900 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() started on 2021-10-30 15:35:56.898954
2021-10-30 15:35:56,900 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:35:56,901 - stpipe.Image3Pipeline.skymatch - INFO - Sky computation method: 'global+match'
2021-10-30 15:35:56,901 - stpipe.Image3Pipeline.skymatch - INFO - Sky matching direction: DOWN
2021-10-30 15:35:56,902 - stpipe.Image3Pipeline.skymatch - INFO - Sky subtraction from image data: OFF
2021-10-30 15:35:56,903 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:35:56,903 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing differences in sky values in overlapping regions.
2021-10-30 15:36:03,550 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0100488
2021-10-30 15:36:03,552 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0214673
2021-10-30 15:36:03,553 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0161271
2021-10-30 15:36:03,553 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0101111
2021-10-30 15:36:03,554 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0
2021-10-30 15:36:03,554 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00916231
2021-10-30 15:36:03,555 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00324911
2021-10-30 15:36:03,556 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0135585
2021-10-30 15:36:03,556 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:36:03,557 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing "global" sky - smallest sky value across *all* input images.
2021-10-30 15:36:03,717 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:36:03,718 - stpipe.Image3Pipeline.skymatch - INFO - "Global" sky value correction: 10.81348739109552 [not converted]
2021-10-30 15:36:03,719 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:36:03,719 - stpipe.Image3Pipeline.skymatch - INFO - ---- Final (match+global) sky for:
2021-10-30 15:36:03,720 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8235 (old=0.0100488, delta=10.8135)
2021-10-30 15:36:03,720 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.835 (old=0.0214673, delta=10.8135)
2021-10-30 15:36:03,721 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8296 (old=0.0161271, delta=10.8135)
2021-10-30 15:36:03,721 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8236 (old=0.0101111, delta=10.8135)
2021-10-30 15:36:03,722 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8135 (old=0, delta=10.8135)
2021-10-30 15:36:03,723 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.8226 (old=0.00916231, delta=10.8135)
2021-10-30 15:36:03,723 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 10.8167 (old=0.00324911, delta=10.8135)
2021-10-30 15:36:03,724 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 10.827 (old=0.0135585, delta=10.8135)
2021-10-30 15:36:03,724 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:36:03,725 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() ended on 2021-10-30 15:36:03.724633
2021-10-30 15:36:03,725 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() TOTAL RUN TIME: 0:00:06.825679
2021-10-30 15:36:03,726 - stpipe.Image3Pipeline.skymatch - INFO -
2021-10-30 15:36:03,743 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch done
2021-10-30 15:36:03,886 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection running with args (<ModelContainer>,).
2021-10-30 15:36:03,889 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None}
2021-10-30 15:36:03,889 - stpipe.Image3Pipeline.outlier_detection - INFO - Step skipped.
2021-10-30 15:36:03,894 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection done
2021-10-30 15:36:04,008 - stpipe.Image3Pipeline.resample - INFO - Step resample running with args (<ModelContainer>,).
2021-10-30 15:36:04,011 - stpipe.Image3Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-30 15:36:04,028 - stpipe.Image3Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2021-10-30 15:36:04,177 - stpipe.Image3Pipeline.resample - INFO - Blending metadata for starfield_50star4ptdither_combined.fits
2021-10-30 15:36:04,748 - stpipe.Image3Pipeline.resample - INFO - Resampling science data
2021-10-30 15:36:05,399 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:06,506 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:07,633 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:08,788 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:09,949 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:11,101 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:12,228 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:13,347 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:13,881 - stpipe.Image3Pipeline.resample - INFO - Resampling var_rnoise
2021-10-30 15:36:14,504 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:15,630 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:16,743 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:17,843 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:19,001 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:20,123 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:21,225 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:22,437 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:22,967 - stpipe.Image3Pipeline.resample - INFO - Resampling var_poisson
2021-10-30 15:36:23,630 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:24,807 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:25,961 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:27,104 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:28,233 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:29,406 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:30,577 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:31,704 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:32,235 - stpipe.Image3Pipeline.resample - INFO - Resampling var_flat
2021-10-30 15:36:32,879 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:34,037 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:35,163 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:36,277 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:37,402 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:38,552 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:39,732 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:40,930 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1111)
2021-10-30 15:36:41,495 - stpipe.Image3Pipeline.resample - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-10-30 15:36:41,497 - stpipe.Image3Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021530548 -0.020360159 0.024603701 0.014659139 359.990565679 0.017646179 359.987492525 -0.017373118
2021-10-30 15:36:41,899 - stpipe.Image3Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_combined_i2d.fits
2021-10-30 15:36:41,900 - stpipe.Image3Pipeline.resample - INFO - Step resample done
2021-10-30 15:36:42,068 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog running with args (<ImageModel(1142, 1111) from starfield_50star4ptdither_combined_i2d.fits>,).
2021-10-30 15:36:42,070 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 100, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 5, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}
2021-10-30 15:36:42,087 - stpipe.Image3Pipeline.source_catalog - INFO - Using APCORR reference file /grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits
2021-10-30 15:36:42,096 - stpipe.Image3Pipeline.source_catalog - INFO - Using ABVEGAOFFSET reference file /grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf
2021-10-30 15:36:42,097 - stpipe.Image3Pipeline.source_catalog - INFO - Instrument: MIRI
2021-10-30 15:36:42,097 - stpipe.Image3Pipeline.source_catalog - INFO - Detector: MIRIMAGE
2021-10-30 15:36:42,098 - stpipe.Image3Pipeline.source_catalog - INFO - Filter: F1130W
2021-10-30 15:36:42,098 - stpipe.Image3Pipeline.source_catalog - INFO - Subarray: FULL
2021-10-30 15:36:42,136 - stpipe.Image3Pipeline.source_catalog - INFO - AB to Vega magnitude offset 5.49349
2021-10-30 15:36:42,571 - stpipe.Image3Pipeline.source_catalog - INFO - Detected 576 sources
2021-10-30 15:36:43,188 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote source catalog: starfield_50star4ptdither_combined_cat.ecsv
2021-10-30 15:36:43,283 - stpipe.Image3Pipeline.source_catalog - INFO - Saved model in starfield_50star4ptdither_combined_segm.fits
2021-10-30 15:36:43,284 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote segmentation map: starfield_50star4ptdither_combined_segm.fits
2021-10-30 15:36:43,285 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog done
2021-10-30 15:36:43,286 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline done
Image 3 pipeline finished.
im = ImageModel('starfield_50star4ptdither_combined_i2d.fits')
pixarea = im.meta.photometry.pixelarea_steradians
print('Pixel area in steradians', pixarea)
# pull out data portion of input file
data = im.data
# print stats on input image
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
Pixel area in steradians 2.84403609523084e-13 Image mean, median and std 1.9009048 0.00061241124 38.082542
# Run DAOStarFinder to find sources in image
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
#sources.pprint_all()
#print(sources['xcentroid','ycentroid','peak'])
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
# using wcs info from images, put coordinates into RA, Dec
ra, dec = im.meta.wcs(sources['xcentroid'], sources['ycentroid'])
print('Number of sources found with DAOStarFinder: ',np.size(ra))
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
print()
# Compare input RA, Dec to found RA, Dec
#print(' RA found Dec found RA_Diff (mas) Dec_diff (mas) pass/fail')
deltara_twoff = []
deltadec_twoff = []
# Put ra, dec coords into a table
cat1_sim = Table([RA_sim, Dec_sim], names=('ra', 'dec'))
cat2_calc = Table([ra, dec], names=('ra', 'dec'))
# Get coordinates with SkyCoord for each catalog
coord_cat1_sim = SkyCoord(ra=cat1_sim['ra'], dec=cat1_sim['dec'], unit="deg")
coord_cat2_calc = SkyCoord(ra=cat2_calc['ra'], dec=cat2_calc['dec'], unit="deg")
ind_cat2_cat1, dist_2d, _ = match_coordinates_sky(coord_cat1_sim, coord_cat2_calc)
# Find where the catalogs match
cat1_matched = cat1_sim[dist_2d.arcsec<0.05]
cat2_matched = cat2_calc[ind_cat2_cat1[dist_2d.arcsec<0.05]]
#print(cat1_matched)
# Get differences in RA, Dec
ra_diff = cat2_matched['ra'] - cat1_matched['ra']
dec_diff = cat2_matched['dec'] - cat1_matched['dec']
#print(ra_diff)
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
# Compare input RA, Dec to found RA, Dec
print('RA_Diff (mas) Dec_diff (mas) pass/fail')
# Find if the differences are within the allowed 30 mas range
for i in np.arange(0,len(ra_diff)):
#if ra_diff[i] < 30 and dec_diff[i] < 30:
deltara_twoff.append(ra_diff[i])
deltadec_twoff.append(dec_diff[i])
if abs(ra_diff[i]) < 30 and abs(dec_diff[i]) < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {}'.format(ra_diff[i], dec_diff[i], test))
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in milliarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltara_twoff,deltadec_twoff)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
print()
meanRAdiff_twoff, medianRAdiff_twoff, stdRAdiff_twoff = sigma_clipped_stats(deltara_twoff, sigma=5.0, maxiters=5) # default sigma=3
meanDecdiff_twoff, medianDecdiff_twoff, stdDecdiff_twoff = sigma_clipped_stats(deltadec_twoff, sigma=5.0, maxiters=5) # default sigma=3
print('RA difference mean, median and std (units in mas)',meanRAdiff_twoff, medianRAdiff_twoff, stdRAdiff_twoff)
print('Dec difference mean, median and std (units in mas)',meanDecdiff_twoff, medianDecdiff_twoff, stdDecdiff_twoff)
Number of sources found with DAOStarFinder: 51
xcentroid ycentroid RA Dec
------------------ ------------------ ---------------------- ----------------------
684.6082524021652 127.02178742022107 0.0008789333773394722 -0.014622751449208583
761.622599025467 130.38929666901936 359.99852635929426 -0.014312239394417841
962.5395042331548 155.62942118872843 359.9924331873545 -0.012997580765421847
1030.0966238058868 160.22619376030426 359.9903739261518 -0.012674823101661669
520.6391743305934 187.06549670725886 0.0060686057488197834 -0.013222763364311736
784.8335947804791 196.4291409176882 359.99799231180236 -0.012224673765681681
449.98462341579364 208.00975801721762 0.00829158108970196 -0.012770643323076035
505.4746879795004 221.66611064941029 0.0066267341982031045 -0.012202547570729336
562.6697054194524 235.21745176940817 0.004909322531828463 -0.01163308389648489
889.4292243396129 257.49788135566376 359.99494923648325 -0.010070538087914476
626.7090084066978 266.42699632853714 0.003029550342679664 -0.01050371526916965
933.3220814869944 285.2391697298827 359.9936779196443 -0.00910173775627543
1020.1176598447582 285.90669359046285 359.99101813959857 -0.008847698842345446
455.95919788434395 299.7442870203829 0.008355231577070963 -0.009941536793822174
467.65957967651076 306.1314018710746 0.00801362860359887 -0.00971419060392329
541.5301135343183 317.04459489946873 0.005777764798640318 -0.00918075116646948
783.1555299455375 327.2158482506177 359.99839572009455 -0.008218630158819112
547.7833728603681 331.72766679400945 0.005625521863224691 -0.008713668756353803
925.3854875945084 345.8094265390031 359.99408429060657 -0.007265715408214086
794.0240114731326 360.406647645184 359.9981517567066 -0.007171590715218379
432.9316335985175 383.70861977625026 0.009287319532179384 -0.0074287479470628885
716.9447599641942 409.6825121935392 0.0006479858462509081 -0.005867974379943773
717.8943499802779 409.9427529225366 0.0006195670918271233 -0.005857438754699232
773.5242929841447 433.10265882007894 359.99897600519245 -0.00499754117007036
611.6358976888118 473.16971165887134 0.00404811589194581 -0.004204535714573981
509.7128816593791 541.8481202564951 0.007358389043987954 -0.002372797781529149
742.4787110721542 566.2163732199687 0.000286227076065515 -0.0009991688439067263
781.8289389713775 576.4117673196687 359.99910699292434 -0.0005806357038846097
475.10247476683185 578.8557771584653 0.008519301844368794 -0.0013310997557454964
747.4682729365915 590.7112332975622 0.00019913907366184058 -0.0002346097081477685
387.6879241601822 629.9543017216795 0.011337366589407092 5.957187564848357e-07
933.4896782706685 675.6504580024367 359.99472338781277 0.0028706305758066947
967.1140087414927 685.0120173554752 359.9937174938114 0.0032481857007443395
1047.6656190263136 700.6853406937058 359.9912895653523 0.003945572906950791
846.5170450969288 709.1917852047338 359.9974806542412 0.0036651258181377338
891.854479778042 743.0563572445977 359.9961815175085 0.004825583298295616
536.0069347860472 819.9078167814603 0.007300351171477237 0.006224629085173339
741.0704232532195 850.7357980174949 0.001095061651868289 0.007721797030945426
1031.753876066738 852.7485568898926 359.99218670339246 0.008565754955574306
838.5854296502758 860.5914402407263 359.9981312969513 0.008286434669007123
554.7260866543514 911.3882560199833 0.006972506885694472 0.009080240006005515
896.3786236311428 968.3628843493576 359.9966490912126 0.011746756571191995
851.5514174243957 974.6416524693832 359.9980406086788 0.011818663076639953
897.1456794127628 983.54779770834 359.99666643255426 0.012214464345416507
1054.363837062679 1027.8265191309158 359.99196451116234 0.013995344293995406
887.1518851323103 1028.3303877633184 359.9970934022871 0.013560823704390839
874.8898474171002 1039.1261327724214 359.997498467911 0.013858876505116819
833.7128385822044 1040.9210839259317 359.9987659864235 0.013803110063588721
972.4689990323386 1056.9607445495576 359.99455420789263 0.014668360815857897
705.8565037011317 1097.4341769502455 0.002838764582663908 0.01519201269409663
536.2194512323524 1111.0393096592175 0.008077277204727616 0.015152714591860609
RA_Diff (mas) Dec_diff (mas) pass/fail
-0.048875 0.396229 pass
-1.915520 10.355418 pass
-2.782526 -11.407838 pass
6.243114 12.428745 pass
12.093459 -4.461820 pass
6.324144 1.473425 pass
5.000558 -10.072014 pass
2.355268 -10.347055 pass
1.086640 -7.559121 pass
-3.378053 2.869311 pass
0.328365 9.923656 pass
1.824789 4.464022 pass
-2.553816 -2.575470 pass
8.361115 6.897973 pass
4.597937 -1.027469 pass
-0.289280 4.544077 pass
-0.847502 18.045699 pass
2.191244 2.387076 pass
2.180696 4.451888 pass
-0.025472 -5.888534 pass
3.618693 -1.948212 pass
-2.449684 -20.692609 pass
5.048233 6.565336 pass
-1.564732 -1.537535 pass
0.851340 5.262884 pass
8.322488 4.774444 pass
1.264217 -1.335293 pass
-4.667787 -0.882160 pass
4.017211 -5.528572 pass
-4.446725 0.895801 pass
-1.759816 1.239458 pass
-0.265853 -2.963166 pass
7.149047 36.092232 fail
0.748414 8.498937 pass
1.863031 -23.100126 pass
1.069025 1.564808 pass
2.091923 8.484037 pass
2.262973 -0.686174 pass
-1.822279 -2.931477 pass
-3.099335 -9.394949 pass
-5.803874 -1.329927 pass
4.274476 -2.090756 pass
3.360158 11.694783 pass
-1.721292 -2.407523 pass
8.033677 8.867542 pass
1.557195 5.271643 pass
9.181234 15.425031 pass
0.502555 1.084168 pass
2.592340 -2.268572 pass
RA difference mean, median and std (units in mas) 1.6521047839497511 1.2642173180529155 3.8862371947562293 Dec difference mean, median and std (units in mas) 1.2555561609228822 0.8958007098727738 9.41417175297422
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data, cmap='Greys', origin='lower', vmin=-5,vmax=10)#, norm=norm)
apertures.plot(color='red', lw=2.5) #, alpha=0.5)
plt.show()
# Take a closer look at a portion of the image to get a closer look at the psf
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data[350:450, 700:820], cmap='Greys', origin='lower', vmin=0,vmax=200)#, norm=norm)
#plt.scatter(sources['xcentroid']-700, sources['ycentroid']-350, color='red')
plt.show()
# Compare stats across tests:
print('All units are milliarcseconds for statistics')
print('Statistics on differences between RA and Dec in individual calibrated files')
print('RA difference mean, median and std',meanRAdiff_cal, medianRAdiff_cal, stdRAdiff_cal)
print('Dec difference mean, median and std',meanDecdiff_cal, medianDecdiff_cal, stdDecdiff_cal)
print()
#print('Statistics on differences between RA and Dec in individual i2d files when run with tweakreg on')
#print('RA difference mean, median and std',meanRAdiff_i2d, medianRAdiff_i2d, stdRAdiff_i2d)
#print('Dec difference mean, median and std',meanDecdiff_i2d, medianDecdiff_i2d, stdDecdiff_i2d)
#print()
print('Statistics on differences between RA and Dec in combined i2d file when run with tweakreg on')
print('RA difference mean, median and std',meanRAdiff_twon, medianRAdiff_twon, stdRAdiff_twon)
print('Dec difference mean, median and std',meanDecdiff_twon, medianDecdiff_twon, stdDecdiff_twon)
print()
print('Statistics on differences between RA and Dec in combined i2d file when run with tweakreg off')
print('RA difference mean, median and std',meanRAdiff_twoff, medianRAdiff_twoff, stdRAdiff_twoff)
print('Dec difference mean, median and std',meanDecdiff_twoff, medianDecdiff_twoff, stdDecdiff_twoff)
All units are milliarcseconds for statistics Statistics on differences between RA and Dec in individual calibrated files RA difference mean, median and std 1.1084997025612093 0.928302277808206 3.5773131993903524 Dec difference mean, median and std -0.17537865973407207 1.1691161048078824 5.539940734870295 Statistics on differences between RA and Dec in combined i2d file when run with tweakreg on RA difference mean, median and std 1.044712286909813 0.4193610587246662 3.4546813255954345 Dec difference mean, median and std 1.1378027151533245 1.9004964490206 5.561995692399732 Statistics on differences between RA and Dec in combined i2d file when run with tweakreg off RA difference mean, median and std 1.6521047839497511 1.2642173180529155 3.8862371947562293 Dec difference mean, median and std 1.2555561609228822 0.8958007098727738 9.41417175297422
If the first set of images with no shift are well aligned as shown in images and the statistical comparison, that test passes.
Once a shift is added, the statistics and number of sources found don't tell the whole story. Look at the combined images shown after image3 with and without tweakreg. If the image run with tweakreg shows double sources just like the image without tweakreg, then the test fails. If the image doesn't show double sources and looks like the unshifted combined image, then the test passes. Examine the image to look for obvious faults like stars that were not identified as stars, those with multiple star identifications, double star images, etc.
Authors: M. Cracraft, M. Libralato and K. Gordon, MIRI Branch
Updated On: 08/25/2021